-- Logs begin at Thu 2022-05-12 17:55:53 UTC, end at Thu 2022-05-12 19:19:43 UTC. -- May 12 18:50:24.775110 dv-cinder-795751-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 18:50:24.784419 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 18:50:24 2022] *** May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: nodename: dv-cinder-795751-3-iscsi May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: machine: x86_64 May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: clock source: unix May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: pcre jit disabled May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: detected number of CPU cores: 4 May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: current working directory: / May 12 18:50:24.786660 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: detected binary path: /usr/bin/uwsgi-core May 12 18:50:24.787462 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: your processes number limit is 47680 May 12 18:50:24.787462 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: your memory page size is 4096 bytes May 12 18:50:24.787462 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: detected max file descriptor number: 2048 May 12 18:50:24.787462 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: lock engine: pthread robust mutexes May 12 18:50:24.787462 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: thunder lock: enabled May 12 18:50:24.787462 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 18:50:24.787462 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 18:50:24.831558 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: Python main interpreter initialized at 0x558cd149e9c0 May 12 18:50:24.831558 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: python threads support enabled May 12 18:50:24.831558 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: your server socket listen backlog is limited to 100 connections May 12 18:50:24.831558 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: your mercy for graceful operations on workers is 90 seconds May 12 18:50:24.831882 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: mapped 403077 bytes (393 KB) for 2 cores May 12 18:50:24.832008 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: *** Operational MODE: preforking *** May 12 18:50:24.832227 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: *** uWSGI is running in multiple interpreter mode *** May 12 18:50:24.832227 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: spawned uWSGI master process (pid: 102548) May 12 18:50:24.832403 dv-cinder-795751-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 18:50:24.833161 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: spawned uWSGI worker 1 (pid: 102549, cores: 1) May 12 18:50:24.833794 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: spawned uWSGI worker 2 (pid: 102550, cores: 1) May 12 18:50:24.833794 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 18:50:26.028995 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 18:50:26.035008 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 18:50:26.770548 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:50:26.770548 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: from cryptography.utils import int_from_bytes May 12 18:50:26.770878 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:50:26.770878 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: from cryptography.utils import int_from_bytes May 12 18:50:26.777801 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:50:26.777801 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: from cryptography.utils import int_from_bytes May 12 18:50:26.778123 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:50:26.778123 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: from cryptography.utils import int_from_bytes May 12 18:50:29.381334 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 18:50:29.381992 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 18:50:29.382087 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 18:50:29.382431 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 18:50:29.382504 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 18:50:29.382570 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 18:50:29.382643 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 18:50:29.382717 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 18:50:29.382927 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 18:50:29.383026 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.383170 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 18:50:29.383331 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.383559 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.383646 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.383891 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.383985 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.384218 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.384305 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.384544 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.384640 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.384871 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.384964 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.385186 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.385276 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.385509 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.385621 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.386312 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.386415 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.386628 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.386763 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.386944 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.387074 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795751-3-iscsi {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.387263 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.387388 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.387567 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.387702 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795751-3-iscsi {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.387879 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.388017 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.388197 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.388316 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.388503 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.388626 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.388824 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.388947 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.389135 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.389260 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.389463 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.389668 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.389816 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.390816 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.390963 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391090 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391227 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391352 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391472 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391592 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391711 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391837 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.391977 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392095 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392224 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392344 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392467 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392587 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392715 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392836 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.392956 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.393081 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.393202 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.393335 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795751-3-iscsi {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.393456 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.393611 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.393790 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795751-3-iscsi {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.393915 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.394112 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.394245 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.394434 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.394567 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.394755 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.394893 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.395155 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.395287 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.395478 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.395607 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.395796 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.395913 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.396102 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.396236 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.396438 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.396594 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.396751 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.396886 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.397085 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.397224 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.397388 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.397514 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.397720 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.397847 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.398032 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.398198 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.398343 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.398467 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.398657 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.398786 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.398968 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.399091 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.399273 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.399398 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.399532 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.399654 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.399803 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.399932 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.400124 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.400254 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.400438 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.400562 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.400758 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.400885 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.400996 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.401123 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.401245 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.401464 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.402120 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.402265 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.402443 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.402605 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.402739 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.402869 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.403050 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.403181 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.403362 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.403487 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.403692 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.403817 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.403965 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.404098 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.404273 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.404399 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.404583 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.404716 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.404891 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.405015 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.405204 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.405338 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.405517 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.405685 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.405861 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.405985 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.406169 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.406313 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.406561 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.406708 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.406831 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.406950 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.407113 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.407252 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.407420 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.407543 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.407757 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.407884 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.408069 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.408204 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.408377 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.408500 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.408697 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.408823 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.409023 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.409153 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.409330 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.409461 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.409664 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.409797 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.409973 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.410108 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.410284 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.410420 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.410598 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.410729 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.410902 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.411269 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.411400 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.411520 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.411700 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.411828 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.412007 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.412133 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.412328 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.412453 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.412636 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.412768 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.412941 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.413064 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.413250 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.413382 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.413643 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.413785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.413955 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.414079 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.414262 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.414394 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.414567 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.414712 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.414874 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.414999 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.415183 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.415306 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.415487 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.415619 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.415796 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.415921 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.416104 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.416240 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.416406 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.416538 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.416750 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.416875 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.417049 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.417176 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.417354 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.417486 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.417697 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.417824 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.418005 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.418141 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.418312 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.418445 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.418622 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.418745 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.418931 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.419054 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.419238 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.419378 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.419553 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.419682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.419860 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.419990 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.420166 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.420304 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.420482 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.420604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.420785 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.420906 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.421091 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.421215 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.421402 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.421578 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.421728 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.421850 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.422037 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.422163 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.422350 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.422480 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.422656 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.422778 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.422962 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.423086 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.423265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.423391 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.423569 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.423692 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.423875 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.424008 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.424181 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.424305 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.424483 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.424619 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.424788 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.424912 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.425089 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.425214 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.425397 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.425547 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.425728 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.425854 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.426043 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.426168 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.426353 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.426491 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.426658 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.426858 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.427015 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.427129 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.427249 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.427379 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.427576 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:50:29.427715 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.427907 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.428044 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.428241 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.428368 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.428573 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.428699 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.428899 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.429022 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.429222 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.429346 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.429579 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.429721 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.429875 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.430000 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.430197 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.430321 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.430505 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.430622 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.430816 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.431015 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.431139 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.431259 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.431433 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.431557 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.431745 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.431877 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.432072 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.432220 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.432387 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.432513 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.433220 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.433347 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.433556 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.433684 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.433873 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.434000 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.434192 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.434326 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.434503 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.434627 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.434825 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.434951 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.435137 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.435272 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.435471 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.435594 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.435788 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.435914 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.436112 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.436248 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.436436 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.436562 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.436757 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.436894 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.437093 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.437219 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.437373 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.437502 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.437725 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.437848 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.438045 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.438185 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.438365 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.438497 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.438676 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.438799 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.438994 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.439121 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.439306 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.439437 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.439625 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.439751 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.439937 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.440069 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.440253 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.440376 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.440565 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.440693 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.440884 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.440990 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.441197 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.441297 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.441510 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.441628 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.441847 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.441935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.442166 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.442253 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.442479 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.442575 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.442790 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.442878 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.443101 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.443188 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.443406 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.443502 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.443712 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.443808 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.444021 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.444109 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.444329 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.444424 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.444636 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.444735 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.444948 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.445035 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.445257 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.445346 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.445604 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.445696 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.445941 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.446042 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.446256 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.446345 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.446575 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.446663 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.446888 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.446982 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.447200 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.447391 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.447513 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.447667 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.447826 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.447968 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.448117 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.448303 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.449017 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.449174 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.449336 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.449498 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.449685 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.449821 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.449988 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.450131 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.450306 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.450456 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.450619 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.450840 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.450983 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.451124 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.451270 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.451414 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.451550 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.451692 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.451833 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.451986 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.452121 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.452267 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.452434 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.452587 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.452761 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.452915 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.453063 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.453206 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.453375 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.453546 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.453719 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.453880 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.454028 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.454164 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.454353 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.454493 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.454678 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.454821 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.455033 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.455168 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.455301 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.455435 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.455608 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.455748 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.455906 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.456042 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.456214 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.456356 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.456522 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.456672 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.456829 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.456972 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.457138 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.457278 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.457441 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.457642 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.457790 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.457943 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.458078 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.458211 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.458351 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.458495 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.458630 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.458764 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.458955 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.459113 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.459248 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.459390 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.459566 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.459706 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.459873 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.460022 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.460166 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.460301 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.460479 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.460626 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.460790 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.461009 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.461161 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.461294 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.461428 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.461581 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.461786 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.461927 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.462114 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.462256 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.462429 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.462571 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.462748 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.462889 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.463060 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.463204 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.463374 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.463522 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.463688 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.463845 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.464022 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.464169 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.464338 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.464485 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.464650 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.464802 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.464971 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.465110 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.465281 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.465429 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.465624 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.465776 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.465921 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.466054 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.466246 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.466387 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.466553 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.466702 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.466871 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.467011 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.467180 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.467320 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.467502 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.467655 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.467836 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.467984 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.468160 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.468301 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.468472 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.468614 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.468786 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.468926 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.469097 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.469238 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.469408 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.469576 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.469727 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.469862 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.470049 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.470191 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.470366 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.470508 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.470674 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.470813 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.471060 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.471211 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.471356 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.471491 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.471633 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.471766 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.471910 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.472042 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.472222 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.472366 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.472528 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.472670 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.472843 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.472993 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.473152 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.473299 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.473470 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.473647 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.473813 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.473981 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.474124 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.474267 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.474436 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.474586 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.474750 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.474901 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.475064 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.475206 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.475377 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.475535 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.475671 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.475815 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.475966 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.476102 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.476279 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.476436 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.476579 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.476713 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.476887 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.477036 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.477177 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.477309 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.477487 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.477678 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.477814 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.477957 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.478129 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.478272 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.478451 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.478603 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.478765 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.478924 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.479060 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.479192 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.479370 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.479522 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.479710 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.479852 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.480031 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.480180 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.480343 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.480483 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.480647 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.480787 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.480955 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.481123 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.481327 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.481467 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.481651 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.481790 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.481938 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.482087 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.482222 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.482378 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.482527 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.482662 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.482796 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.482939 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.483099 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.483242 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.483407 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.483558 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.483767 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.483923 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.484059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.484194 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.484338 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.484472 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.484617 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.484752 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.484923 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.485080 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.485216 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.485356 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.485558 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.485704 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.485860 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.485996 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.486172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.486315 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.486485 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.486629 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.486794 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.486934 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.487102 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.487251 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.487396 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.487540 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.487713 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.487881 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.488023 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.488134 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.488316 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.488409 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.488626 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.488716 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.488930 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.489029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.489239 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.489351 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.489564 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.489720 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.489868 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.490145 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.490296 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.490479 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.490736 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.490879 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.491074 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.491217 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.491396 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.491547 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.491715 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.491855 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.492040 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.492190 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.492365 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.492507 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.492700 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.492849 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.493001 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.493150 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.493291 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.493425 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.493637 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.493789 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.493932 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.494077 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.494224 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.494366 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.494501 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.494643 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.494804 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.494947 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.495652 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.495798 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.495933 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.496086 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.496220 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.496371 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.496519 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.496668 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.496804 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.496938 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.497072 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.497213 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.497385 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.497550 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.497728 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.497871 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.498041 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.498199 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.498344 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.498485 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.498655 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.498803 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.498965 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.499115 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.499271 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.499421 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.499577 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.499734 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.499876 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.500019 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.500216 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.500376 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.500518 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.500657 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.500848 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.500999 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.501156 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.501296 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.501500 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.501687 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.501832 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.501965 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.502100 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.502240 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.502439 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.502606 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.502751 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.502893 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.503030 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.503164 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.503319 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.503469 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.503658 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.503799 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.503940 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.504076 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.504220 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.504354 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.504496 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.504631 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.504812 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.504962 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.505123 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.505274 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.505433 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.505619 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.505759 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.505892 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.506055 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.506224 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.506369 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.506505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.506660 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.506801 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.506968 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.507127 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.507276 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.507427 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.507569 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.507704 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.507874 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.508101 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.508256 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.508392 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.508525 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.508665 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.508808 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.508942 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.509076 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.509209 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.509345 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.509479 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.509698 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.509836 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.509970 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.510114 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.510432 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.510577 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.510766 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.511400 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.511400 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.511666 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.511800 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.511934 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.512076 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.512211 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.512344 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.512480 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.512623 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.512767 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.512935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.513077 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.513243 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.513383 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.513552 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.513706 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.513850 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.513983 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.514165 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.514321 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.514474 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.514621 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.514756 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.514890 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.515085 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.515233 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.515395 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.515550 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.515694 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.515829 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.515991 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.516133 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.516296 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.516457 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.516596 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.516730 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.516895 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.517037 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.517181 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.517315 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.517481 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.517677 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.517815 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.517949 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.518094 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.518230 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.518382 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.518516 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.518694 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.518836 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.518979 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.519114 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.519287 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.519435 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.519576 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.519723 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.519909 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.520061 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.520217 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.520366 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.520561 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.520713 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.520850 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.520990 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.521167 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.521315 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.521486 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.521668 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.521813 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.521948 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.522124 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.522283 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.522445 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.522595 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.522744 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.522892 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.523034 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.523175 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.523324 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.523466 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.523629 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.523779 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.523932 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.524137 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.524310 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.524453 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.524634 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.524775 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.524915 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.525063 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.525212 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.525353 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.525494 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.525639 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.525775 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.525867 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.526101 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.526193 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.526444 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.526534 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.526756 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.526852 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.527072 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.527163 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.527383 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.527472 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.527698 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.527801 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.528020 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.528113 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.528327 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.528489 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.528631 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.528778 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.528942 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.529089 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.529256 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.529412 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.529591 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.529752 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.529895 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.530035 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.530196 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.530356 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.530497 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.530650 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.530791 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.530929 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.531110 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.531264 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.531415 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.531555 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.531705 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.531847 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.532009 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.532175 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.532329 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.532478 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.532619 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.532759 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.532900 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.533040 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.533245 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.533393 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.533568 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.533728 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.533937 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.534097 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.534253 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.534400 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.534549 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.534689 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.534828 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.534978 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.535141 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.535291 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.535457 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.535613 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.535761 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.535919 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.536363 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.536526 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.536668 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.536808 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.537018 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.537248 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.537392 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.537575 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.537726 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.537867 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.538007 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.538159 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.538300 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.538440 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.538597 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.538751 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.538900 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.539041 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.539181 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.539321 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.539461 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.539608 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.539758 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.539905 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.540052 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.540193 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.540343 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.540492 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.540743 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.540890 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.541053 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.541200 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.541362 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.541510 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.541805 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.541998 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.542148 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.542287 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.542526 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.542693 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.542836 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.542977 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.543164 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.543312 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.543491 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.543648 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.543789 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.543938 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.544102 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.544273 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.544427 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.544570 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.544721 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.544871 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.545038 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.545186 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.545351 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.545506 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.545711 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.545865 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.546006 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.546147 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.546287 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.546428 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.546610 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.546767 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.546909 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.547050 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.547237 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.547385 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.547601 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.547742 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.547883 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.548022 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.548263 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.548411 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.548586 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.548746 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.548887 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.549026 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.549207 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.549355 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.549505 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.549679 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.549848 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.549997 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.550148 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.550302 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.550443 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.550583 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.550740 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.550887 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.551055 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.551212 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.551364 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.551511 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.551653 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.551793 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.551957 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.552115 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.552258 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.552398 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.552546 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.552704 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.552846 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.552995 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.553144 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.553286 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.553462 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.553663 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.553808 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.553962 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.554103 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.554244 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.554422 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.554589 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.554739 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.554880 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.555030 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.555171 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.555334 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.555484 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.555633 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.555775 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.555936 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.556085 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.556227 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.556367 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.556570 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.556718 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.556859 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.556999 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.557189 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.557338 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.557511 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.558199 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.558363 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.558514 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.558657 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.558813 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.558996 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.559156 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.559307 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.559448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.559628 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.559785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.559948 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.560098 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.560267 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.560414 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.560555 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.560704 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.560846 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.560996 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.561161 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.561319 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.561474 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.561657 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.561802 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.561943 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.562084 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.562224 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.562375 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.562517 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.562670 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.562812 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.562973 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.563115 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.563268 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.563410 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.563551 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.563692 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.563833 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.563975 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.564125 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.564267 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.564437 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.564593 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.564735 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.564900 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.565056 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.565212 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.565361 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.565508 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.565683 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.565837 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.565988 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.566130 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.566278 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.566419 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.566594 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.566753 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.566911 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.567060 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.567231 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.567380 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.567543 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.567705 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.567848 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.567996 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.568169 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.568318 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.568468 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.568610 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.568770 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.568912 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.569084 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.569241 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.569402 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.569614 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.569764 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.569906 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.570046 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.570187 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.570337 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.570485 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.570636 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.570787 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.570935 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.571077 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.571231 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.571373 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.571594 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.571748 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.571890 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.572058 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.572378 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.572527 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.572695 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.572845 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.573003 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.573174 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.573879 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.574042 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.574184 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.574326 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.574500 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.574658 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.574801 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.574942 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.575113 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.575263 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.575415 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.575567 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.575738 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.575888 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.576063 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.576214 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.576392 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.576543 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.576718 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.576879 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.577029 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.577176 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.577403 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.577589 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.577750 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.577893 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.578034 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.578187 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.578329 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.578474 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.578624 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.578765 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.578905 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.579054 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.579209 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.579357 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.579498 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.579647 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.579801 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.579943 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.580114 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.580271 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.580434 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.580584 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.580735 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.580883 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.581038 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.581180 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.581353 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.581502 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.581688 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.581840 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.581982 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.582122 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.582294 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.582465 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.582609 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.582752 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.582940 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.583088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.583261 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.583417 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.583581 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.583730 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.583897 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.584054 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.584203 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.584352 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.584499 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.584733 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.584883 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.585041 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.585332 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.585489 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.585674 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.585817 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.586014 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.586164 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.586346 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.586495 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.586662 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.586810 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.586985 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.587150 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.587305 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.587446 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.587621 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.587768 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.587909 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.588051 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.588200 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.588353 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.588495 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.588636 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.588777 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.588953 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.589105 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.589246 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.589386 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.589553 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.589727 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.589887 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.590044 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.590200 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.590383 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.590558 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.590709 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.590903 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.591219 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.591386 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.591528 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.591667 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.591856 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.592015 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.592179 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.592330 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.592478 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.592619 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.592799 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.592949 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.593091 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.593242 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.593405 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.593607 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.593768 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.593910 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.594057 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.594206 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.594347 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.594488 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.594637 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.594786 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.594939 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.595080 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.595231 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.595380 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.595531 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.595672 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.595813 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.595971 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.596113 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.596261 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.596411 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.596551 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.596692 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.596840 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.596987 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.597148 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.597297 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.597440 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.597599 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.597748 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.597889 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.598041 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.598183 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.598324 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.598488 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.598637 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.598779 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.598932 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.599084 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.599232 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.599373 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.599515 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.599668 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.599810 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.599972 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.600122 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.600291 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.600446 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.600597 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.600739 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.600880 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.601044 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.601228 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.601384 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.601575 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.601726 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.601867 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.602008 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.602149 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.602290 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.602464 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.602645 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.602800 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.602953 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.603094 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.603243 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.603385 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.603524 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.603672 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.603824 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.604004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.604163 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.604312 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.604477 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.604748 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.604903 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.605056 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.605206 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.605487 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.605664 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.605846 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.605997 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.606180 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.606402 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.606546 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.606688 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.606829 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.606970 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.607124 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.607286 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.607428 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.607569 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.607710 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.607851 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.608047 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.608190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.608332 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.608473 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.608621 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.608769 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.608923 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.609075 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.609217 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.609363 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.609504 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.609696 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.609849 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.609992 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.610134 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.610274 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.610421 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.610571 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.610722 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.610872 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.611024 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.611164 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.611312 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.611465 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.611615 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.611764 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.611906 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.612079 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.612237 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.612430 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.612585 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.612756 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.612915 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.613078 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.613240 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.613384 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.613575 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.613725 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.613865 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.614006 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.614154 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.614319 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.614524 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.614672 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.614811 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.614964 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.615113 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.615257 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.615396 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.615571 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.615721 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.615877 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.616019 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.616170 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.616313 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.616557 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.616704 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.616864 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.617007 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.617182 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.617333 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.617506 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.617720 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.617876 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.618019 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.618159 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.618311 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.618454 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.618604 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.618756 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.618898 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.619086 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.619235 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.619401 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.619565 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.619714 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.619855 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.620523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.620680 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.620848 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.621012 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.621155 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.621306 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.621454 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.621628 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.621782 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.621924 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.622093 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.622242 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.622383 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.622524 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.622678 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.622826 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.622989 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.623149 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.623290 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.623431 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.623585 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.623727 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.623869 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.624010 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.624157 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.624298 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.624448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.624620 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.624767 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.624914 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.625067 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.625216 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.625358 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.625499 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.625692 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.625836 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.625986 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.626141 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.626283 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.626424 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.626564 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.626704 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.626846 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.627006 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.627182 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.627336 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.627479 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.627620 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.627767 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.627922 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.628081 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.628265 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.628410 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.628551 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.628701 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.628849 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.629002 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.629142 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.629283 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.629423 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.629597 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.629746 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.629888 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.630029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.630177 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.630318 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.630472 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.630620 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.630772 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.630918 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.631073 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.631215 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.631401 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.631558 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.631700 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.631840 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.631981 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.632131 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.632272 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.632413 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.632554 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.632713 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.632863 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.633013 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.633155 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.633296 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.633438 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.633634 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.633787 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.633939 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.634082 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.634252 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.634402 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.634564 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.634783 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.634935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.635076 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.635225 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.635374 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.635515 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.635688 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.635874 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.636519 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.636661 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.636803 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.636995 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.637163 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.637306 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.637447 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.637663 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.637815 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.638002 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.638152 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.638302 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.638443 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.638616 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.638765 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.638937 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.639095 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.639245 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.639387 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.639554 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.639703 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.639875 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.640032 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.640197 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.640346 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.640527 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.640675 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.640851 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.641000 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.641179 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.641327 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.641510 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.641711 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.641861 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.642003 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.642143 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.642284 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.642430 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.642580 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.642722 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 18:50:29.642873 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.643155 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.643475 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.643788 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:50:29.644037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 18:50:29.665884 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:29.667507 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:29.728495 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.context [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c29fec8-2219-4b87-8182-3dbdeb30f262(cell1) {{(pid=102549) load_cells /opt/stack/nova/nova/context.py:464}} May 12 18:50:29.730738 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.context [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c29fec8-2219-4b87-8182-3dbdeb30f262(cell1) {{(pid=102550) load_cells /opt/stack/nova/nova/context.py:464}} May 12 18:50:29.732869 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:50:29.734481 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:50:29.735048 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:50:29.735253 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:50:29.736619 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:50:29.737176 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_concurrency.lockutils [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:50:29.737415 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:50:29.739369 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:50:29.748773 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:29.752302 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:29.755800 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:29.758892 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:29.912933 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG oslo_db.sqlalchemy.engines [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:29.916631 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_db.sqlalchemy.engines [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:50:30.248610 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:50:30.249435 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:50:30.255967 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:50:30.256752 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:50:30.596241 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:50:30.602262 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: WARNING keystonemiddleware.auth_token [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:50:30.608761 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cd149e9c0 pid: 102550 (default app) May 12 18:50:30.609370 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:50:30.610844 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:50:30.612007 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 May 12 18:50:30.612429 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu May 12 18:50:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:50:30.615526 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: WARNING keystonemiddleware.auth_token [None req-7adb3678-4bdd-479f-bf02-7aa9c1094f64 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:50:30.623293 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cd149e9c0 pid: 102549 (default app) May 12 18:51:48.320516 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:51:48.321553 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 12 18:51:48.321963 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:51:48.739357 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-1632180f-307d-4b8a-9432-b0902597a848 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:51:48.770421 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-1632180f-307d-4b8a-9432-b0902597a848 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.441755 May 12 18:51:48.771207 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 12 18:51:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:51:51.047248 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:51:51.048277 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-abb32063-aa44-4ce9-af80-ce45fd11c43a None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 12 18:51:51.048708 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:51:51.112533 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-970c4bda-cbfb-40f0-8404-408e941794d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "name": "cirros256", "disk": 1}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:51.134341 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:51:51.134341 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 12 18:51:51.163336 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-970c4bda-cbfb-40f0-8404-408e941794d0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108628 May 12 18:51:51.169681 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:51:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:51:51.381797 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-5c34b2f5-cca9-450d-ac2f-d6cbc57d0e77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:51.384268 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:51:51.384268 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 12 18:51:51.432687 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-5c34b2f5-cca9-450d-ac2f-d6cbc57d0e77 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260755 May 12 18:51:51.433466 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 12 18:51:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:51:53.762123 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-970c4bda-cbfb-40f0-8404-408e941794d0 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:51:53.763867 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-970c4bda-cbfb-40f0-8404-408e941794d0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002312 May 12 18:51:53.765515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:51:53.877640 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-8be77537-d65d-44b5-b1e4-7396fc1a3f15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:53.896567 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:51:53.896567 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 12 18:51:53.918385 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-8be77537-d65d-44b5-b1e4-7396fc1a3f15 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146633 May 12 18:51:53.919391 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:51:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:51:53.931208 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-5aa15fd3-de0e-481a-a1e2-1290f79bbc4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:53.932707 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:51:53.932707 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: warnings.warn(msg) May 12 18:51:53.966568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-5aa15fd3-de0e-481a-a1e2-1290f79bbc4b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038960 May 12 18:51:53.967081 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 12 18:51:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:51:56.270480 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-8be77537-d65d-44b5-b1e4-7396fc1a3f15 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:51:56.271799 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-8be77537-d65d-44b5-b1e4-7396fc1a3f15 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001794 May 12 18:51:56.272206 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:51:56.335977 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-50e87fa9-5b8b-4688-9139-e34ad2f76eee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:56.355854 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-50e87fa9-5b8b-4688-9139-e34ad2f76eee admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077715 May 12 18:51:56.356407 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:51:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:51:56.368912 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-6a64ff46-bb9a-4082-bdac-df58973c8e43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:56.392454 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-6a64ff46-bb9a-4082-bdac-df58973c8e43 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027070 May 12 18:51:56.392953 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 12 18:51:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:51:58.678417 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-50e87fa9-5b8b-4688-9139-e34ad2f76eee admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:51:58.679548 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-50e87fa9-5b8b-4688-9139-e34ad2f76eee admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 May 12 18:51:58.679970 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:51:58.739768 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-92df9cc2-fff0-4f4c-8995-f051f184ae88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:58.757304 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-92df9cc2-fff0-4f4c-8995-f051f184ae88 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070770 May 12 18:51:58.757934 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:51:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 18:51:58.769736 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-52dfd4a4-5988-4aec-b8a3-43d5a9d1ed55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:51:58.793212 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-52dfd4a4-5988-4aec-b8a3-43d5a9d1ed55 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027184 May 12 18:51:58.793984 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 12 18:51:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:52:01.061350 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-92df9cc2-fff0-4f4c-8995-f051f184ae88 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:01.062393 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-92df9cc2-fff0-4f4c-8995-f051f184ae88 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 12 18:52:01.062797 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:01.122632 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b52be9e8-0297-4ce5-8a5b-d902b91c3702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:01.141019 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-b52be9e8-0297-4ce5-8a5b-d902b91c3702 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071696 May 12 18:52:01.141915 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:52:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:01.153299 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-f406b6c4-a163-4196-bb88-e3ee802ae795 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:01.176220 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-f406b6c4-a163-4196-bb88-e3ee802ae795 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026518 May 12 18:52:01.177343 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 12 18:52:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:52:03.435910 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b52be9e8-0297-4ce5-8a5b-d902b91c3702 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:03.436950 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-b52be9e8-0297-4ce5-8a5b-d902b91c3702 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 12 18:52:03.437375 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:03.498116 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-b4e08452-9249-4241-bfdb-df4c4a39e47b admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:03.522035 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-b4e08452-9249-4241-bfdb-df4c4a39e47b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077752 May 12 18:52:03.522576 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 12 18:52:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:52:05.832229 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-b52be9e8-0297-4ce5-8a5b-d902b91c3702 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:05.834250 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-b52be9e8-0297-4ce5-8a5b-d902b91c3702 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002498 May 12 18:52:05.834834 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:05.896876 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-1cf860f3-71e0-49b2-989f-c75ca371c407 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:05.914736 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-1cf860f3-71e0-49b2-989f-c75ca371c407 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073000 May 12 18:52:05.915316 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:52:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 18:52:05.927009 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-74802a19-6328-4833-9bb0-36f92d125422 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:05.949865 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-74802a19-6328-4833-9bb0-36f92d125422 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026398 May 12 18:52:05.950540 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 12 18:52:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:52:08.219603 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-1cf860f3-71e0-49b2-989f-c75ca371c407 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:08.220632 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-1cf860f3-71e0-49b2-989f-c75ca371c407 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 12 18:52:08.221039 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:08.281148 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4e57451c-b021-43c4-8ae2-9189d7833a36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:08.299516 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4e57451c-b021-43c4-8ae2-9189d7833a36 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071975 May 12 18:52:08.300071 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:52:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:08.312336 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-5c2a565a-62df-4468-84a7-f2f38d2b27aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:08.334955 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-5c2a565a-62df-4468-84a7-f2f38d2b27aa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026219 May 12 18:52:08.335541 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 12 18:52:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:52:10.944329 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4e57451c-b021-43c4-8ae2-9189d7833a36 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:10.945337 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4e57451c-b021-43c4-8ae2-9189d7833a36 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 12 18:52:10.945774 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:11.003728 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-41f754d0-72f8-480e-9ce8-4da6c1654f9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "id": "3"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:11.021412 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-41f754d0-72f8-480e-9ce8-4da6c1654f9d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069410 May 12 18:52:11.022002 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:52:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 18:52:11.033913 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-74e8d6aa-5354-44b1-9fb9-44523806388b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:11.055093 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-74e8d6aa-5354-44b1-9fb9-44523806388b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025198 May 12 18:52:11.055672 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 12 18:52:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:52:13.291516 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-41f754d0-72f8-480e-9ce8-4da6c1654f9d admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:13.292536 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-41f754d0-72f8-480e-9ce8-4da6c1654f9d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 12 18:52:13.292941 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:13.351102 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-661e9117-2d0f-4ecb-a54f-bbc19bdf239a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:13.369889 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-661e9117-2d0f-4ecb-a54f-bbc19bdf239a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071078 May 12 18:52:13.370434 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:52:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:13.382086 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-8a6e541b-f3b4-40ba-84b6-c702457ecebc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:13.404658 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-8a6e541b-f3b4-40ba-84b6-c702457ecebc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026345 May 12 18:52:13.405306 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 12 18:52:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:52:15.720784 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-661e9117-2d0f-4ecb-a54f-bbc19bdf239a admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:15.721836 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-661e9117-2d0f-4ecb-a54f-bbc19bdf239a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 12 18:52:15.722402 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:15.785774 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c4891697-354e-4512-9997-200f1a519684 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:15.805061 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c4891697-354e-4512-9997-200f1a519684 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076232 May 12 18:52:15.805640 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 12 18:52:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:15.817329 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-c7ee1774-2641-4ece-8dc7-0aecbb38c07a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:15.839743 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-c7ee1774-2641-4ece-8dc7-0aecbb38c07a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026121 May 12 18:52:15.840893 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 12 18:52:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:52:40.013786 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c4891697-354e-4512-9997-200f1a519684 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:40.014804 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c4891697-354e-4512-9997-200f1a519684 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 12 18:52:40.015201 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:52:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:40.071838 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-e6326036-7570-4aa9-ad8c-33bd025c4b3b admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:40.088224 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-e6326036-7570-4aa9-ad8c-33bd025c4b3b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067155 May 12 18:52:40.088746 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 12 18:52:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:52:41.094830 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c4891697-354e-4512-9997-200f1a519684 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:41.095835 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c4891697-354e-4512-9997-200f1a519684 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 12 18:52:41.096294 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:41.289938 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-95e0dc76-5d92-4108-89c5-2a13b44d352e admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:41.295387 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.wsgi [None req-95e0dc76-5d92-4108-89c5-2a13b44d352e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-95e0dc76-5d92-4108-89c5-2a13b44d352e admin admin] Request method failure captured: May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Accept: application/json May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Accept-Encoding: gzip, deflate May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Connection: keep-alive May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Content-Length: 0 May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Host: 10.222.0.48 May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Openstack-Api-Version: compute 2.90 May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Openstack-System-Scope: None May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: User-Agent: python-novaclient May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Auth-Token: gAAAAABifVd5FU4t7_NmwPZTsBbouaA4xJ39oXZTNgTnb4GUo0pI2GODmHGR-btEzrrj9-SQKlXUPmCvAxojARBWBxxwy6IO6_TY45XpyM0gW5n7Bb80-djxgY4-nmOVqoZF3jysXRV1Dtb1dtq9XVHs4D_VUcBhCPsgFpUoE0I4Z-bmDizCWZk May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Domain-Id: None May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Domain-Name: None May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Identity-Status: Confirmed May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Is-Admin-Project: True May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Openstack-Nova-Api-Version: 2.90 May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Id: default May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Name: Default May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Name: admin May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Role: member,reader,admin May 12 18:52:41.298604 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Roles: member,reader,admin May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_039d8e8cc62f44a2bdf4d5f5334c1312", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant: admin May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant-Name: admin May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User: admin May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Id: default May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Name: Default May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Id: 39e02c8648054bf7b77e58c3e22a7e1e May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Name: admin May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: method: > May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: exception: Flavor 42 could not be found. May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: action_args: {'id': '42'} May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:52:41.300265 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:41.301515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:41.303004 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-95e0dc76-5d92-4108-89c5-2a13b44d352e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:52:41.304966 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-95e0dc76-5d92-4108-89c5-2a13b44d352e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060846 May 12 18:52:41.304966 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 12 18:52:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 18:52:41.310373 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c4944d70-d29b-4237-b379-2d44adc8b329 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:41.330343 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c4944d70-d29b-4237-b379-2d44adc8b329 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023533 May 12 18:52:41.330876 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 12 18:52:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:52:41.347740 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f606dbc6-79f8-4dc1-8b5a-b60aca194de9 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:41.369260 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-f606dbc6-79f8-4dc1-8b5a-b60aca194de9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025005 May 12 18:52:41.369835 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 12 18:52:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:52:41.378589 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-bc60c308-b4b7-4c68-a64c-33935c4b600f admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:41.383884 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.wsgi [None req-bc60c308-b4b7-4c68-a64c-33935c4b600f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-bc60c308-b4b7-4c68-a64c-33935c4b600f admin admin] Request method failure captured: May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Accept: application/json May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Accept-Encoding: gzip, deflate May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Connection: keep-alive May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Content-Length: 0 May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Host: 10.222.0.48 May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Openstack-Api-Version: compute 2.90 May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Openstack-System-Scope: None May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: User-Agent: python-novaclient May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Auth-Token: gAAAAABifVd5FU4t7_NmwPZTsBbouaA4xJ39oXZTNgTnb4GUo0pI2GODmHGR-btEzrrj9-SQKlXUPmCvAxojARBWBxxwy6IO6_TY45XpyM0gW5n7Bb80-djxgY4-nmOVqoZF3jysXRV1Dtb1dtq9XVHs4D_VUcBhCPsgFpUoE0I4Z-bmDizCWZk May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Domain-Id: None May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Domain-Name: None May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Identity-Status: Confirmed May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Is-Admin-Project: True May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Openstack-Nova-Api-Version: 2.90 May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Id: default May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Name: Default May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Name: admin May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Role: member,reader,admin May 12 18:52:41.387119 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Roles: member,reader,admin May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_039d8e8cc62f44a2bdf4d5f5334c1312", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant: admin May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant-Name: admin May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User: admin May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Id: default May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Name: Default May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Id: 39e02c8648054bf7b77e58c3e22a7e1e May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Name: admin May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: method: > May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: exception: Flavor 42 could not be found. May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: action_args: {'id': '42'} May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:52:41.388785 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:41.389935 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:41.391221 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-bc60c308-b4b7-4c68-a64c-33935c4b600f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:52:41.392420 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-bc60c308-b4b7-4c68-a64c-33935c4b600f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013371 May 12 18:52:41.392420 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 12 18:52:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 18:52:42.276088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f606dbc6-79f8-4dc1-8b5a-b60aca194de9 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:42.277131 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-f606dbc6-79f8-4dc1-8b5a-b60aca194de9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 12 18:52:42.277730 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:42.465433 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c22e57d0-c53d-4cc4-b8ad-bb0fefdda67b admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:42.470562 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.wsgi [None req-c22e57d0-c53d-4cc4-b8ad-bb0fefdda67b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c22e57d0-c53d-4cc4-b8ad-bb0fefdda67b admin admin] Request method failure captured: May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Accept: application/json May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Accept-Encoding: gzip, deflate May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Connection: keep-alive May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Content-Length: 0 May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Host: 10.222.0.48 May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Openstack-Api-Version: compute 2.90 May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Openstack-System-Scope: None May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: User-Agent: python-novaclient May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Auth-Token: gAAAAABifVd6UUVp5oMZleMrD7MlPPmx3vRn9GmS_pyFrMtKiQrg18pPjNCj2ZC3H2x8P4sQBVRsIpnal-2-o1QTH4vXBhPMOcKywZ9XRSFKcJ03WxA2Ddstzz6iu0bTSwMG3ieQPmF3F8iJ8lJCS3Nh1bnEfRiAxDvw0FvLaAM5ZLPIwsxjJXQ May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Domain-Id: None May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Domain-Name: None May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Identity-Status: Confirmed May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Is-Admin-Project: True May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Openstack-Nova-Api-Version: 2.90 May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Id: default May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Name: Default May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Name: admin May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Role: member,reader,admin May 12 18:52:42.472037 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Roles: member,reader,admin May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_039d8e8cc62f44a2bdf4d5f5334c1312", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant: admin May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant-Name: admin May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User: admin May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Id: default May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Name: Default May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Id: 39e02c8648054bf7b77e58c3e22a7e1e May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Name: admin May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: method: > May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: exception: Flavor 84 could not be found. May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: action_args: {'id': '84'} May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:52:42.473342 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:42.474190 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:42.475498 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c22e57d0-c53d-4cc4-b8ad-bb0fefdda67b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:52:42.476859 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c22e57d0-c53d-4cc4-b8ad-bb0fefdda67b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058566 May 12 18:52:42.476859 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 12 18:52:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 18:52:42.483148 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-7d7a560f-9e9e-4b34-bc71-b09ce54010bf admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:42.496940 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-7d7a560f-9e9e-4b34-bc71-b09ce54010bf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017367 May 12 18:52:42.497456 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 12 18:52:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:52:42.506318 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-637af6b6-3ece-460c-9d56-0a66ed5684b2 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:42.520058 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-637af6b6-3ece-460c-9d56-0a66ed5684b2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017070 May 12 18:52:42.520573 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 12 18:52:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 18:52:42.529217 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-eee38b02-a470-4073-9e49-2720e3e29c2d admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:42.534191 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.wsgi [None req-eee38b02-a470-4073-9e49-2720e3e29c2d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-eee38b02-a470-4073-9e49-2720e3e29c2d admin admin] Request method failure captured: May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Accept: application/json May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Accept-Encoding: gzip, deflate May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Connection: keep-alive May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Content-Length: 0 May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Host: 10.222.0.48 May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Openstack-Api-Version: compute 2.90 May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Openstack-System-Scope: None May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: User-Agent: python-novaclient May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Auth-Token: gAAAAABifVd6UUVp5oMZleMrD7MlPPmx3vRn9GmS_pyFrMtKiQrg18pPjNCj2ZC3H2x8P4sQBVRsIpnal-2-o1QTH4vXBhPMOcKywZ9XRSFKcJ03WxA2Ddstzz6iu0bTSwMG3ieQPmF3F8iJ8lJCS3Nh1bnEfRiAxDvw0FvLaAM5ZLPIwsxjJXQ May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Domain-Id: None May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Domain-Name: None May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Identity-Status: Confirmed May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Is-Admin-Project: True May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Openstack-Nova-Api-Version: 2.90 May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Id: default May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Name: Default May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Name: admin May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Role: member,reader,admin May 12 18:52:42.535682 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Roles: member,reader,admin May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_039d8e8cc62f44a2bdf4d5f5334c1312", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant: admin May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant-Name: admin May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User: admin May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Id: default May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Name: Default May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Id: 39e02c8648054bf7b77e58c3e22a7e1e May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Name: admin May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: method: > May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: exception: Flavor 84 could not be found. May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: action_args: {'id': '84'} May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:52:42.537448 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:42.539088 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:42.540380 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-eee38b02-a470-4073-9e49-2720e3e29c2d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:52:42.541658 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-eee38b02-a470-4073-9e49-2720e3e29c2d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011478 May 12 18:52:42.541658 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 12 18:52:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 18:52:43.410079 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-637af6b6-3ece-460c-9d56-0a66ed5684b2 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:43.411370 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-637af6b6-3ece-460c-9d56-0a66ed5684b2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 12 18:52:43.411765 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:43.595914 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f1b23f08-dd06-4ab3-ab03-5a1016447208 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:43.602009 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.wsgi [None req-f1b23f08-dd06-4ab3-ab03-5a1016447208 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f1b23f08-dd06-4ab3-ab03-5a1016447208 admin admin] Request method failure captured: May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Accept: application/json May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Accept-Encoding: gzip, deflate May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Connection: keep-alive May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Content-Length: 0 May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Host: 10.222.0.48 May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Openstack-Api-Version: compute 2.90 May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Openstack-System-Scope: None May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: User-Agent: python-novaclient May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Auth-Token: gAAAAABifVd7y7mjges1XpD1CbTvpSescjJ-iRk4Iqz5yMMWZcI7JtTOgTGcvnWhWjrduGlM4fGTKBEIQsNhjhPltC9CAtoASrHpZxfPJIn6vSUm6XXXrVSYjYlQBLxl6OaJRURgPjiMDFUkT2krrXjspBQze1qZMaM2d2GBxXR65NQ_BJVNYP8 May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Domain-Id: None May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Domain-Name: None May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Identity-Status: Confirmed May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Is-Admin-Project: True May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Openstack-Nova-Api-Version: 2.90 May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Id: default May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Domain-Name: Default May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Project-Name: admin May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Role: member,reader,admin May 12 18:52:43.603523 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Roles: member,reader,admin May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_039d8e8cc62f44a2bdf4d5f5334c1312", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant: admin May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-Tenant-Name: admin May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User: admin May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Id: default May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Domain-Name: Default May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Id: 39e02c8648054bf7b77e58c3e22a7e1e May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: X-User-Name: admin May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: method: > May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: exception: Flavor 451 could not be found. May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: action_args: {'id': '451'} May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:52:43.605059 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:43.606172 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: ERROR nova.api.openstack.wsgi May 12 18:52:43.607568 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-f1b23f08-dd06-4ab3-ab03-5a1016447208 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:52:43.608800 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-f1b23f08-dd06-4ab3-ab03-5a1016447208 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058695 May 12 18:52:43.608800 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 12 18:52:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 18:52:43.614481 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-20f6d717-3aa6-48d3-adcf-e3b233471feb admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:43.628570 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-20f6d717-3aa6-48d3-adcf-e3b233471feb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017628 May 12 18:52:43.629029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 12 18:52:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:52:43.638232 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:43.652482 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017708 May 12 18:52:43.653012 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 12 18:52:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:52:43.662275 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-177ca43b-71a9-4cd9-9709-cec3c8cb4af3 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:43.668009 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.wsgi [None req-177ca43b-71a9-4cd9-9709-cec3c8cb4af3 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-177ca43b-71a9-4cd9-9709-cec3c8cb4af3 admin admin] Request method failure captured: May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Accept: application/json May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Accept-Encoding: gzip, deflate May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Connection: keep-alive May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Content-Length: 0 May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Host: 10.222.0.48 May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Openstack-Api-Version: compute 2.90 May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Openstack-System-Scope: None May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: User-Agent: python-novaclient May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Auth-Token: gAAAAABifVd7y7mjges1XpD1CbTvpSescjJ-iRk4Iqz5yMMWZcI7JtTOgTGcvnWhWjrduGlM4fGTKBEIQsNhjhPltC9CAtoASrHpZxfPJIn6vSUm6XXXrVSYjYlQBLxl6OaJRURgPjiMDFUkT2krrXjspBQze1qZMaM2d2GBxXR65NQ_BJVNYP8 May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Domain-Id: None May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Domain-Name: None May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Identity-Status: Confirmed May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Is-Admin-Project: True May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Openstack-Nova-Api-Version: 2.90 May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Id: default May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Domain-Name: Default May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Project-Name: admin May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Role: member,reader,admin May 12 18:52:43.669505 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Roles: member,reader,admin May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_039d8e8cc62f44a2bdf4d5f5334c1312", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/039d8e8cc62f44a2bdf4d5f5334c1312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant: admin May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant-Id: 039d8e8cc62f44a2bdf4d5f5334c1312 May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-Tenant-Name: admin May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User: admin May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Id: default May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Domain-Name: Default May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Id: 39e02c8648054bf7b77e58c3e22a7e1e May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: X-User-Name: admin May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: method: > May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: exception: Flavor 451 could not be found. May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: action_args: {'id': '451'} May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:52:43.671053 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:43.672029 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: ERROR nova.api.openstack.wsgi May 12 18:52:43.673126 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-177ca43b-71a9-4cd9-9709-cec3c8cb4af3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:52:43.674173 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-177ca43b-71a9-4cd9-9709-cec3c8cb4af3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012369 May 12 18:52:43.674173 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 12 18:52:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 18:52:44.546239 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:44.547259 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 12 18:52:44.547657 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:44.733282 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c0a2758b-9383-4aea-bbe2-93cbe9cbac03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:44.750206 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c0a2758b-9383-4aea-bbe2-93cbe9cbac03 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067574 May 12 18:52:44.750736 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 12 18:52:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:45.631807 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:45.632814 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 12 18:52:45.633217 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:45.819519 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-88afe39e-4bab-4b5f-8511-62f77b9de784 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:45.836201 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-88afe39e-4bab-4b5f-8511-62f77b9de784 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067145 May 12 18:52:45.836747 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 12 18:52:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:46.726535 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:46.727548 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 May 12 18:52:46.727954 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:46.914303 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-e5d58ae6-7574-4169-a25e-1c31b68d1f63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:46.931078 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-e5d58ae6-7574-4169-a25e-1c31b68d1f63 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067512 May 12 18:52:46.931616 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 12 18:52:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:47.811005 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:47.812017 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 12 18:52:47.812425 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:47.998848 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-70ad9241-d583-4f58-b8da-5e9ff86ca3eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:52:48.017496 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-70ad9241-d583-4f58-b8da-5e9ff86ca3eb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068728 May 12 18:52:48.018058 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 12 18:52:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:52:48.905173 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:48.906215 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 12 18:52:48.906617 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:52:49.093399 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-b14352f9-95a2-43f0-87cb-22a6bbe27d07 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:52:49.112798 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-b14352f9-95a2-43f0-87cb-22a6bbe27d07 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071007 May 12 18:52:49.113326 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu May 12 18:52:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:53:50.744444 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:53:50.745449 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-4af26240-3860-448f-8466-ae10507bcae8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 12 18:53:50.745891 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 12 18:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:53:50.804506 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-490f1e9c-f222-48d3-9a7e-11af31d78559 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:53:50.824012 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-490f1e9c-f222-48d3-9a7e-11af31d78559 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072396 May 12 18:53:50.824551 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 12 18:53:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:53:50.846316 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-44089ab6-cb51-47fa-92bf-245dff2893fa admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:53:50.854341 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-44089ab6-cb51-47fa-92bf-245dff2893fa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012226 May 12 18:53:50.854865 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Thu May 12 18:53:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:53:50.865460 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-03ec038d-0be1-4226-a64e-1dbda5799e88 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:53:50.873403 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-03ec038d-0be1-4226-a64e-1dbda5799e88 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011359 May 12 18:53:50.873946 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Thu May 12 18:53:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:53:50.884983 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:53:50.892489 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011372 May 12 18:53:50.893033 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Thu May 12 18:53:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:53:50.907159 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-bac28280-cac6-4801-9834-8829b7d9e52c admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:53:50.915120 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-bac28280-cac6-4801-9834-8829b7d9e52c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012782 May 12 18:53:50.915662 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Thu May 12 18:53:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:57:18.023065 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:18.024082 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 12 18:57:18.024515 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:57:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:57:18.290901 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-eab6a133-a83c-4f02-83d4-5d4453767c6b admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:18.292072 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:57:18.292072 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 12 18:57:18.293260 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-eab6a133-a83c-4f02-83d4-5d4453767c6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:18.293984 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-eab6a133-a83c-4f02-83d4-5d4453767c6b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:18.294769 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-eab6a133-a83c-4f02-83d4-5d4453767c6b admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:18.295194 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-eab6a133-a83c-4f02-83d4-5d4453767c6b admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:18.327949 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-eab6a133-a83c-4f02-83d4-5d4453767c6b admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151134 May 12 18:57:18.328486 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 12 18:57:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:57:19.218793 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:19.219854 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 12 18:57:19.220270 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:57:19.407597 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-c34802b2-4cc7-4aa4-99c4-5684c1d0e494 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:19.408762 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:57:19.408762 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 12 18:57:19.409963 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-c34802b2-4cc7-4aa4-99c4-5684c1d0e494 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:19.410415 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-c34802b2-4cc7-4aa4-99c4-5684c1d0e494 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:19.411217 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-c34802b2-4cc7-4aa4-99c4-5684c1d0e494 admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:19.411639 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-c34802b2-4cc7-4aa4-99c4-5684c1d0e494 admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:19.430876 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-c34802b2-4cc7-4aa4-99c4-5684c1d0e494 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073506 May 12 18:57:19.431420 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 12 18:57:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 18:57:30.865250 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:30.866335 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 12 18:57:30.866757 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:57:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:57:31.054369 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-8384cd68-a466-4ce4-8dfb-d2ab42d4f8d2 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:31.055536 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:57:31.055536 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 12 18:57:31.056776 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-8384cd68-a466-4ce4-8dfb-d2ab42d4f8d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:31.057772 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-8384cd68-a466-4ce4-8dfb-d2ab42d4f8d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:31.058565 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-8384cd68-a466-4ce4-8dfb-d2ab42d4f8d2 admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:31.058988 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-8384cd68-a466-4ce4-8dfb-d2ab42d4f8d2 admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:31.083931 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-8384cd68-a466-4ce4-8dfb-d2ab42d4f8d2 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079684 May 12 18:57:31.084478 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 12 18:57:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:57:31.970569 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: DEBUG nova.api.openstack.wsgi [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] Calling method '>' {{(pid=102549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:31.971585 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: INFO nova.api.openstack.requestlog [None req-c427d37e-556b-4df0-9595-a1fc536d03ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 12 18:57:31.971988 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: [pid: 102549|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 12 18:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:57:32.162862 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG nova.api.openstack.wsgi [None req-fa4ac35b-d80f-4b55-a050-679b849ca389 admin admin] Calling method '>' {{(pid=102550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:57:32.164058 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 18:57:32.164058 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: warnings.warn(msg) May 12 18:57:32.165321 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-fa4ac35b-d80f-4b55-a050-679b849ca389 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:32.165799 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-fa4ac35b-d80f-4b55-a050-679b849ca389 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:32.166628 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-fa4ac35b-d80f-4b55-a050-679b849ca389 admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:57:32.167060 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: DEBUG oslo_concurrency.lockutils [None req-fa4ac35b-d80f-4b55-a050-679b849ca389 admin admin] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:57:32.188855 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: INFO nova.api.openstack.requestlog [None req-fa4ac35b-d80f-4b55-a050-679b849ca389 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077165 May 12 18:57:32.189419 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: [pid: 102550|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 12 18:57:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:58:28.017636 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: Thu May 12 18:58:28 2022 - graceful shutdown triggered... May 12 18:58:28.018157 dv-cinder-795751-3-iscsi devstack@n-api.service[102549]: Gracefully killing worker 1 (pid: 102549)... May 12 18:58:28.017746 dv-cinder-795751-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 18:58:28.019042 dv-cinder-795751-3-iscsi devstack@n-api.service[102550]: Gracefully killing worker 2 (pid: 102550)... May 12 18:58:29.018755 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: worker 1 buried after 1 seconds May 12 18:58:29.018755 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: worker 2 buried after 1 seconds May 12 18:58:29.019418 dv-cinder-795751-3-iscsi devstack@n-api.service[102548]: goodbye to uWSGI. May 12 18:58:29.020325 dv-cinder-795751-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 18:58:29.020884 dv-cinder-795751-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 18:58:29.023608 dv-cinder-795751-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 18:58:29.039638 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 18:58:29 2022] *** May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: nodename: dv-cinder-795751-3-iscsi May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: machine: x86_64 May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: clock source: unix May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: pcre jit disabled May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: detected number of CPU cores: 4 May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: current working directory: / May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: detected binary path: /usr/bin/uwsgi-core May 12 18:58:29.060254 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: your processes number limit is 47680 May 12 18:58:29.061093 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: your memory page size is 4096 bytes May 12 18:58:29.061093 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: detected max file descriptor number: 2048 May 12 18:58:29.061093 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: lock engine: pthread robust mutexes May 12 18:58:29.061093 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: thunder lock: enabled May 12 18:58:29.061093 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 18:58:29.061093 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 18:58:29.109449 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: Python main interpreter initialized at 0x55e6a12ad9c0 May 12 18:58:29.109449 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: python threads support enabled May 12 18:58:29.109449 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: your server socket listen backlog is limited to 100 connections May 12 18:58:29.109449 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: your mercy for graceful operations on workers is 90 seconds May 12 18:58:29.109921 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: mapped 403077 bytes (393 KB) for 2 cores May 12 18:58:29.109921 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: *** Operational MODE: preforking *** May 12 18:58:29.110172 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: *** uWSGI is running in multiple interpreter mode *** May 12 18:58:29.110172 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: spawned uWSGI master process (pid: 117084) May 12 18:58:29.110375 dv-cinder-795751-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 18:58:29.110973 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: spawned uWSGI worker 1 (pid: 117101, cores: 1) May 12 18:58:29.111477 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: spawned uWSGI worker 2 (pid: 117102, cores: 1) May 12 18:58:29.111752 dv-cinder-795751-3-iscsi devstack@n-api.service[117084]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 18:58:30.311367 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 18:58:30.318589 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 18:58:31.106793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:58:31.106793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: from cryptography.utils import int_from_bytes May 12 18:58:31.107122 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:58:31.107122 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: from cryptography.utils import int_from_bytes May 12 18:58:31.130741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:58:31.130741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: from cryptography.utils import int_from_bytes May 12 18:58:31.131064 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 18:58:31.131064 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: from cryptography.utils import int_from_bytes May 12 18:58:33.527331 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 18:58:33.527884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 18:58:33.528203 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 18:58:33.528499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 18:58:33.528764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 18:58:33.529160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.529495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.529863 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.530192 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.530532 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.530851 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.531180 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.531509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.531847 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.532116 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.532443 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.532776 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795751-3-iscsi {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.533106 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.533421 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.533767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.534099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.534414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.534745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.535060 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.535566 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.538383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.538383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.538685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.539302 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.539798 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.540139 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.540468 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.540796 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.541139 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.541466 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.541913 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795751-3-iscsi {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.542249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.542596 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.543172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.543610 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.543936 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.544263 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.544597 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.544933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.545254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.545616 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.545952 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.546284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.546616 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.546929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.547257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.547576 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.547907 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.548225 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.548542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.548802 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.549124 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.549462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.549822 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.550157 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.550430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.550681 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.551007 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.551337 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.551658 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.551976 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.552294 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.552613 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.552931 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.553257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.553589 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.553910 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.554240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.554567 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.554897 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.555764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.556142 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.556559 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.556823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.557143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.557495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.557861 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.558184 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.558511 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.558843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.559182 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.559485 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.559895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.560160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.560443 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.560758 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.561052 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.561326 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.561666 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.561997 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.562313 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.562631 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.562947 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.563257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.563575 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.563889 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.564203 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.564520 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.564837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.565150 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.565464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.565818 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.566132 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.566460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.566789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.567103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.567418 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.567739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.568053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.568380 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.568695 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.569006 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.569336 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.569688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.570089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.570349 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.570632 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.571542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.571818 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.572130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.572448 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.572773 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.573086 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.573399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.573809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.574123 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.574439 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.574755 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.575067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.575381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.575689 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.576016 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.576344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.576664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.576978 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.577292 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.577829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.578372 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.578712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.579230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.579561 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.579984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.580286 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.580572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.581244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.581244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.581577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.581720 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 18:58:33.582210 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.582466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 18:58:33.582624 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.582765 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 18:58:33.582902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.582902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.583178 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 18:58:33.583178 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 18:58:33.583441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.583592 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.583745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.583978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.584133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.584283 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.584423 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.584574 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.584712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.584862 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.585025 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.585249 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.585405 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.585561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.585713 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.585874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.586012 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.586160 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.586309 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.586499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.586657 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.586797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.586945 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.587085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795751-3-iscsi {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.587231 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.587379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.587535 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.587686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.587844 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.587982 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.588130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.588268 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.588417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.588555 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.588705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.588842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.588979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.589136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.589281 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.589579 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.589767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.589875 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.589958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.590191 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.590425 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.590537 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.590616 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.590782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.590892 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.591100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.591193 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.591416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.591506 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.591741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.591837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.592056 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.592146 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.592387 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.592484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.592703 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.592813 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.593024 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.593116 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795751-3-iscsi {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.593344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.593440 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.593687 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.593785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.594033 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.594128 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.594315 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.594481 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.594628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.594800 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.594940 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.595118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.595269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.595450 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.595571 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.595784 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.595888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.596081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.596217 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.596414 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.596532 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.596741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.596875 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.597067 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.597189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.597398 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.597508 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.598457 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.598614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.598761 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.598914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.599076 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.599231 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.599377 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.599520 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.599681 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.599908 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.600059 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.600353 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.600618 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.600784 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.601026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.601188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.601345 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.601497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.601665 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.601820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.601973 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.602194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.602350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.602350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.602797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.603048 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.603211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.603211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.603496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.603648 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.603799 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.603943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.604116 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.604116 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.604475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.604628 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.604771 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.604939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.605091 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.605254 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.605408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.605408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.605802 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.605968 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.605968 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.606242 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.606394 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.606539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.606691 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.606861 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.607013 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.607165 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.607316 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.607467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.607612 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.607764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.607915 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.608059 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.608210 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.608354 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.608591 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.608752 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.608916 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.609075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.609220 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.609374 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.609518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.609719 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.609902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.610119 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.610422 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.610662 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.610824 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.610977 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.611224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.611385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.611530 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.611698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.611962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.612141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.612297 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.612448 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.612592 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.612743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.612895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.613077 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.613313 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.613472 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.613652 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.613801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.613995 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.614157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.614329 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.615174 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.615342 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.615499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.615644 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.615817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.616053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.616205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.616348 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.616503 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.616657 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.616803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.616948 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.617092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.617236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.617388 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.617566 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.618217 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.618217 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.618510 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.618739 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.618891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.619062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.619207 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.619352 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.619504 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.619649 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.619793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.619947 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.620110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.620334 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.620634 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.620856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.621020 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.621203 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.621426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.621619 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.621785 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.621932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.622075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.622220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.622364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.622517 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.622668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.622820 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.622972 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.623123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.623279 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.623546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.623705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.623849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.624004 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.624157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.624310 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.624467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.624700 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.624852 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.624998 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.625157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.625315 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.625483 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.625670 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.625818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.625970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.626217 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.626383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.626530 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.626680 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.626831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.626976 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.627120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.627317 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.627476 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.627645 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.627798 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.627798 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.628073 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.628232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.628459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.628623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.628851 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.629002 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.629146 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.629301 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.629445 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.629839 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.630001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.630146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.630323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.630685 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.630860 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.630860 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.631216 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 18:58:33.631369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.631678 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.631841 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.631986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.632140 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.632297 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.632456 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.632615 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.632767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.632912 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.634321 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.634489 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.634636 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.634875 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.635036 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.635202 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.635374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.635764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.635921 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.636066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.636230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.636485 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.636636 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.636780 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.636939 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.637096 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.637241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.637399 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.637615 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.637781 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.637939 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.638086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.638240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.638384 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.638528 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.638672 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.638843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.639081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.639251 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.639404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.639549 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.639692 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.639847 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.639992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.640146 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.640291 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.640442 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.640831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.640987 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.641230 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.641393 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.641570 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.641797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.641948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.642104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.642263 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.642415 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.642560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.642703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.642846 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.642997 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.643150 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.643304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.643455 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.643599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.643599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.643880 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.644047 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.644192 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.644462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.644623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.644784 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.645025 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.645198 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.645362 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.645507 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.645709 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.645854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.646010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.646155 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.646311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.646474 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.646717 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.646877 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.647037 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.647404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.647562 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.647562 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.647835 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.647979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.648138 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.648290 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.648448 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.648593 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.648737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.649101 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.649339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.649493 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.649673 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.649832 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.649977 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.650136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.650288 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.650432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.650802 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.651123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.651395 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.651556 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.651701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.651872 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.652027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.652187 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.652339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.652492 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.652645 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.652797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.652956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.653107 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.653263 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.653423 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.653618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.653778 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.653938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.654090 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.654234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.654385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.654646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.654807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.654967 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.655213 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.655363 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.655519 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.655672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.655825 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.655984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.656141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.656291 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.656446 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.656590 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.656759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.656924 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.657070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.657221 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.657366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.657519 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.657715 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.657862 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.658005 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.658149 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.658301 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.658444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.658597 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.658741 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.658893 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.659053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.659205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.659458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.659624 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.659770 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.659923 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.660075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.660219 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.660376 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.660527 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.660670 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.660838 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.661184 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.661336 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.661621 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.661787 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.661942 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.662096 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.662249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.662400 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.662624 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.662788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.662941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.663086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.663230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.663381 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.663541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.663694 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.663857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.664009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.664163 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.664317 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.664461 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.664658 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.664896 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.665065 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.665243 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.665471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.665645 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.665802 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.665957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.666101 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.666253 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.666410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.666561 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.666713 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.666864 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.667008 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.667151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.667311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.667455 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.667605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.668027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.668190 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.668369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.668598 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.668777 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.668932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.669091 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.669242 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.669407 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.669743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.669858 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.669950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670036 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670129 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670323 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670493 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670576 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670761 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.670938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671023 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671111 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671193 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671369 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671540 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671705 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671795 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671880 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.671962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672061 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672342 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672508 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672598 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672683 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672683 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672854 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.672938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673028 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673111 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673194 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673295 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673380 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.673956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674040 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674123 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674471 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.674930 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675263 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675357 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675529 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675608 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675693 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675845 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.675997 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676069 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676210 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676375 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676586 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676662 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676816 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676893 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.676964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677147 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677233 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677514 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677514 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677514 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677737 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677816 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.677964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678117 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678189 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678398 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678477 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678549 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678626 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678714 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678789 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678871 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.678952 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.679033 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.679112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.679191 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.681556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.681702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.681794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.681869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.681947 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682195 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682309 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682492 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.682983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683069 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683153 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683244 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683822 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683908 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.683983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.684248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.684346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.684537 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.684656 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.684867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.684962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.685189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.685285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.685513 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.685682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.685855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.685984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.686172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.686307 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.686502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.686624 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.686825 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.686947 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.687140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.687272 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.687459 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.687602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.687776 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.687937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.688093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.688230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.688415 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.688660 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.688754 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.688984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.689078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.689308 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.689408 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.689654 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.689752 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.689972 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.690065 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.690284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.690375 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.690602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.690702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.690936 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.691189 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.691340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.691526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.691622 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.691847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.691941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.692173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.692303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.692486 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.692587 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.692810 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.692903 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.693148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.693248 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.693482 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.693853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.694125 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.694228 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.694472 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.694684 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.694785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.694911 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.695083 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.695238 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.695403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.695563 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.695714 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.695952 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.696568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.696779 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.696879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.697116 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.697210 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.697433 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.697562 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.697787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.697882 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.698098 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.698197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.698414 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.698505 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.698733 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.698839 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.699044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.699143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.699361 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.699454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.699670 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.699775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.699999 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.700091 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.700313 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.700404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.700621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.700722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.700930 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.701029 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.701244 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.701386 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.701668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.701794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.701982 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.702085 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.702494 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.702619 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.702713 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.702789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.703120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.703219 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.703294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.703374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.703638 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.703734 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.703919 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.704019 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.704201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.704301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.704487 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.704586 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.704762 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.704854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.705072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.705182 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.705385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.705483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.705807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.705920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.706033 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.706143 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.706345 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.706437 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.706659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.706752 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.706974 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.707074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.707277 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.707368 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.707589 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.707682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.707898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.707999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.708226 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.708319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.708540 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.708640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.708850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.708951 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.709179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.709281 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.709468 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.709588 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.709804 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.709904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.710111 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.710204 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.710425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.710518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.710731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.710825 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.711052 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.711144 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.711364 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.711499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.711695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.711811 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.712010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.712119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.712323 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.712426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.712635 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.712734 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.712943 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.713034 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.713271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.713377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.713609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.713706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.713921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.714013 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.714229 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.714338 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.714542 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.714635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.714848 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.714941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.715155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.715260 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.715469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.715567 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.715787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.715880 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.716098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.716224 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.716404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.716495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.716712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.716823 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.717017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.717116 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.717323 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.717423 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.717653 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.717760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.717966 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.718060 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.718278 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.718378 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.718585 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.718677 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.718891 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.718984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.719196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.719294 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.719501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.719602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.719823 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.719922 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.720134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.720233 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.720438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.720538 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.720743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.720835 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.721049 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.721142 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.721461 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.721647 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.721738 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.721867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.722083 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.722214 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.722408 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.722518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.722849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.722955 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.723037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.723125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.723483 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.723578 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.723654 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.723726 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.723968 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.724071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.724250 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.724351 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.724572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.724669 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.724888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.724996 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.725207 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.725441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.725564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.725821 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.725938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.726147 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.726245 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.726471 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.726574 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.726792 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.726898 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.727136 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.727239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.727460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.727561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.727785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.727890 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.728095 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.728189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.728414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.728627 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.728762 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.728887 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.729025 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.729118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.729337 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.729438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.729676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.729792 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.729993 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.730086 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.730308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.730404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.730622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.730717 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.730939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.731039 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.731254 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.731347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.731568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.731675 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.731949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.732062 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.732247 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.732353 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.732530 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.732632 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.732982 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.733080 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.733154 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.733244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.733596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.733709 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.733786 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.733866 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.734072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.734175 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.734389 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.734482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.734702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.734800 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.735035 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.735132 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.735357 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.735465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.735680 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.735787 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.736015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.736123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.736342 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.736449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.736757 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.736857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.737045 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.737138 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.737334 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.737435 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.737645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.737744 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.738037 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.738137 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.738360 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.738466 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.738677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.738790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.738992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.739090 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.739301 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.739409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.739613 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.739725 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.739926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.740025 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.740254 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.740360 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.740563 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.740676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.740873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.740979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.741182 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.741288 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.741509 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.741638 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.741841 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.741950 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.742219 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.742329 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.742503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.742613 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.743334 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.743448 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.743666 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.743782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.743985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.744090 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.744411 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.744520 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.744725 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.744868 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.745050 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.745192 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.745375 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.745551 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.745731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.745880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.746041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.746207 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.746359 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.746523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.746673 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.746857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.747002 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.747172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.747331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.747486 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.747645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.747815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.747963 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.748132 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.748279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.748446 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.748606 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.748758 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.748932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.749075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.749248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.749391 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.749597 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.749737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.750020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.750116 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.750350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.750452 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.750668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.750762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.750983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.751074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.751297 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.751391 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.751607 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.751724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.751916 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.752012 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.752226 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.752331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.752533 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.752634 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.752843 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.752937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.753152 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.753253 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.753470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.753620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.753807 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.753918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.754116 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.754282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.754427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.754520 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.754734 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.754827 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.755041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.755143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.755355 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.755454 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.755661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.755754 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.755987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.756092 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.756303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.756399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.756630 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.756723 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.756954 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.757048 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.757262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.757361 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.757611 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.757708 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.757927 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.758028 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.758240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.758494 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.759126 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.759221 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.759443 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.759537 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.759791 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.759991 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.760091 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.760336 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.760440 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.760666 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.760767 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.761008 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.761101 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.761365 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.761458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.761729 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.761823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.762064 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.762161 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.762380 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.762474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.762701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.762793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.763017 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.763108 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.763326 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.763419 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.763640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.763774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.763954 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.764062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.764262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.764376 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.764573 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.764678 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.764883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.764996 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.765197 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.765301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.765505 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.765635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.765839 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.765954 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.766154 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.766248 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.766482 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.766588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.766796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.766920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.767127 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.767224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.767434 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.767524 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.767750 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.767843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.768053 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.768144 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.768376 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.768469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.768753 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.768870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.769032 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.769126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.769349 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.769448 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.769692 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.769788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.770020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.770113 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.770355 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.770454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.770671 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.770765 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.770982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.771073 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.771309 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.771410 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.772220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.772326 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.772413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.772496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.772577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.772577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.772860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.773181 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.773495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.773839 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.774186 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.774511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.775044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.775380 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.775700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.776020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.776340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.776658 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.776978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.777296 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.777684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.777841 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.777948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.778231 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.778342 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.778581 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.778679 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.778908 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.779017 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.779238 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.779344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.779578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.779685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.779901 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.779999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.780219 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.780327 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.780540 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.780639 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.780996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.781151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.781229 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.781313 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.781549 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.781914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.782035 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.782127 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.782211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.782411 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.782758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.782889 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.783025 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.783126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.783467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.783576 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.783910 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.784173 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.784276 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.784555 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.784662 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.784962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.785115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.785288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.785631 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.785738 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.786072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.786167 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.786408 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.786748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.786987 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.787086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.787316 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.787434 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.787641 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.787756 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.787962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.788064 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.788278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.788529 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.788912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.789015 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.789155 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.789257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.789462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.790101 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.790347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.790451 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.790668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.790770 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.790981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.791090 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.791296 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.791406 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.791606 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.791701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.791917 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.792022 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.792227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.792327 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.792542 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.792644 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.793112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.793255 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.793442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.793567 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.793789 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.793941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.794108 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.794268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.794437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.794575 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.794752 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.794897 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.795227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.795359 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.795554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.795675 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.795880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.795983 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.796196 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.796292 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.796534 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.796736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.796833 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.796921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.797152 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.797257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.797470 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.797596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.797810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.797907 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.798121 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.798216 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.798443 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.798544 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.798759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.798863 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.799070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.799172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.799387 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.799489 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.799701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.799826 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.800020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.800125 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.800328 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.800457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.800645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.800752 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.800974 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.801074 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.801416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.801512 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.801837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.801963 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.802185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.802280 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.802504 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.802630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.802817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.802913 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.803128 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.803242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.803437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.803542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.803747 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.803850 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.804056 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.804150 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.804373 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.804510 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.804684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.804844 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.804999 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.805196 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.805357 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.806111 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.806210 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.806430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.806539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.806783 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.806878 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.807117 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.807219 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.807438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.807570 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.807758 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.807896 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.808067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.808169 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.808320 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 18:58:33.808416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.808686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.809013 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.809331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.809688 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.810041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.810362 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.810902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.811240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.811565 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.811902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.812237 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.812550 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.812860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.813176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.813501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.813838 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.814157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.814470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.814785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.815100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.815414 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.815728 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.816044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.816357 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.816672 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.816986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.817300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.817641 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.817987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.818313 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.818637 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.818958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.819280 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.819600 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.819913 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.820226 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.820541 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.820883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.821218 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.821579 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.821868 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.822296 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.822615 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.822938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.823318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.823573 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.823900 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.824227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.824542 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.824871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.825187 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.825533 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.825890 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.826224 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.826558 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.826871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.827182 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.827489 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.827818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.828122 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.828436 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.828738 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.829047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.829366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.829696 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.830016 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.830315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.830619 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.830944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.831244 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.831544 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.831857 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.832159 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.832426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_db.sqlalchemy.engines [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:33.832536 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.832759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.833070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.833402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.833719 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.834027 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.834334 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.834702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.834979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.835317 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.835635 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.835963 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.836280 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.836631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.836948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.837274 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.837622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.837949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.838264 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.838599 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.838914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.839233 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.839548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.839862 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.840177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.840491 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.840824 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.841155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.841468 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.841824 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.842148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.842476 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.842799 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.843115 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.843453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.843772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.844088 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.844408 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.844761 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.845035 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.845355 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.845699 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.846033 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.846365 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.846699 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.847031 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.847385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.847705 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.848055 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.848392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.848711 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.849028 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.849344 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 18:58:33.849614 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 18:58:33.873406 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_db.sqlalchemy.engines [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:33.896732 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.context [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c29fec8-2219-4b87-8182-3dbdeb30f262(cell1) {{(pid=117101) load_cells /opt/stack/nova/nova/context.py:464}} May 12 18:58:33.901371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:58:33.902967 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:58:33.903773 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:58:33.905705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:58:33.918947 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_db.sqlalchemy.engines [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:33.920174 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_db.sqlalchemy.engines [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:33.941424 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.context [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c29fec8-2219-4b87-8182-3dbdeb30f262(cell1) {{(pid=117102) load_cells /opt/stack/nova/nova/context.py:464}} May 12 18:58:33.945899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:58:33.951220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:58:33.952081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:58:33.954789 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:58:33.968522 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_db.sqlalchemy.engines [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:33.969868 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_db.sqlalchemy.engines [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:34.081434 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_db.sqlalchemy.engines [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:34.131941 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_db.sqlalchemy.engines [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 18:58:34.402827 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: WARNING keystonemiddleware.auth_token [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:58:34.410320 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: WARNING keystonemiddleware.auth_token [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:58:34.463485 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: WARNING keystonemiddleware.auth_token [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:58:34.471470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: WARNING keystonemiddleware.auth_token [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:58:34.755261 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: WARNING keystonemiddleware.auth_token [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:58:34.762042 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: WARNING keystonemiddleware.auth_token [None req-67e33edf-c891-4d8e-93cb-95d9a3f528f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:58:34.767393 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6a12ad9c0 pid: 117101 (default app) May 12 18:58:34.819957 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: WARNING keystonemiddleware.auth_token [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 18:58:34.826708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: WARNING keystonemiddleware.auth_token [None req-cf67c48b-741c-407a-9f2a-c41b8842b8b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 18:58:34.832044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6a12ad9c0 pid: 117102 (default app) May 12 18:59:17.383582 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1ce46bf5-037e-4b23-b16c-593eda1253b8 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Action: 'create', calling method: .version_select at 0x7f38c44b4280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-476958800", "metadata": {"Type": "work"}}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:19.230220 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1ce46bf5-037e-4b23-b16c-593eda1253b8 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.998415 May 12 18:59:19.232131 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 12 18:59:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3002 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 18:59:19.746275 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8d3fa936-0920-4ca5-95f4-3c543ec5374d tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Calling method '.version_select at 0x7f38c44dcf70>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:20.179382 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8d3fa936-0920-4ca5-95f4-3c543ec5374d tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854" status: 200 len: 352 microversion: 2.1 time: 0.938988 May 12 18:59:20.180253 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 18:59:19 2022] GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854 => generated 352 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:20.604399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-864679522", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "networks": [{"uuid": "39bce4c1-f617-4e88-ab89-38b69663f080"}]}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:20.766509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] validate_networks() for [('39bce4c1-f617-4e88-ab89-38b69663f080', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 18:59:21.193970 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9c2b0afe-4098-4308-9c7f-5f50e7c21ecd tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Calling method '.version_select at 0x7f38c4376280>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:21.275802 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9c2b0afe-4098-4308-9c7f-5f50e7c21ecd tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854" status: 200 len: 353 microversion: 2.1 time: 0.086132 May 12 18:59:21.277043 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 18:59:21 2022] GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:21.291091 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-663fadb4-5b3e-4782-a8c4-5497398707eb tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Calling method '.version_select at 0x7f38c4376940>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:21.357553 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-663fadb4-5b3e-4782-a8c4-5497398707eb tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854" status: 200 len: 353 microversion: 2.1 time: 0.070557 May 12 18:59:21.358427 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 18:59:21 2022] GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 18:59:21.376163 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-aba261fd-2044-4f98-bfe3-d151f5f03f29 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Calling method '.version_select at 0x7f38c4376af0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:21.532376 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-aba261fd-2044-4f98-bfe3-d151f5f03f29 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854" status: 202 len: 0 microversion: 2.1 time: 0.164001 May 12 18:59:21.536546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 4/5] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 18:59:21 2022] DELETE /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 18:59:21.542690 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d85a8ae3-a081-4e0e-961c-c18749d5aaa5 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Calling method '.version_select at 0x7f38c4376310>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:21.619557 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d85a8ae3-a081-4e0e-961c-c18749d5aaa5 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854" status: 200 len: 352 microversion: 2.1 time: 0.080854 May 12 18:59:21.620532 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 5/6] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 18:59:21 2022] GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854 => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:22.636936 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3047ab45-fffb-41c0-85e6-8e5ab3673c32 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Calling method '.version_select at 0x7f38c43810d0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:22.702965 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-3047ab45-fffb-41c0-85e6-8e5ab3673c32 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] HTTP exception thrown: Volume 07b11c54-7c6e-47ee-92ec-bbe1117b1854 could not be found. May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3047ab45-fffb-41c0-85e6-8e5ab3673c32 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Request method failure captured: May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854 HTTP/1.1 May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkEHZRIaCosOTqMlmr2RPs-7TwqHOtywQZkMrGIAq1Zf0RZiZ5NXNdJaSjm59WvYGZ2XL-91FZMCWYUp309xTHHBSGYYBKkIs35BBiuCc1wZcPlljgEaLwaNaexhnrLYFRJGVpW3B_WOekOr9YAA85YQh3Es81Uuu3DSZxny65OyrQ May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: e919eefce93845b8bbd05ebb732096db May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesGetTestJSON-1086945885 May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 18:59:22.707425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e919eefce93845b8bbd05ebb732096db", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e919eefce93845b8bbd05ebb732096db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e919eefce93845b8bbd05ebb732096db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e919eefce93845b8bbd05ebb732096db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesGetTestJSON-1086945885 May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: e919eefce93845b8bbd05ebb732096db May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesGetTestJSON-1086945885 May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesGetTestJSON-1086945885-project May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 3d23a659c657413dbb7d438077f8af03 May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesGetTestJSON-1086945885-project May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Volume 07b11c54-7c6e-47ee-92ec-bbe1117b1854 could not be found. May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '07b11c54-7c6e-47ee-92ec-bbe1117b1854'} May 12 18:59:22.708840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07b11c54-7c6e-47ee-92ec-bbe1117b1854 could not be found. (HTTP 404) (Request-ID: req-2ea2e966-d5a2-44a2-a849-cbc0acf86b9e) May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:22.741348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 18:59:22.748333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07b11c54-7c6e-47ee-92ec-bbe1117b1854 could not be found. May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 18:59:22.749612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07b11c54-7c6e-47ee-92ec-bbe1117b1854 could not be found. May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07b11c54-7c6e-47ee-92ec-bbe1117b1854 could not be found. May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3047ab45-fffb-41c0-85e6-8e5ab3673c32 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] Returning 404 to user: Volume 07b11c54-7c6e-47ee-92ec-bbe1117b1854 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3047ab45-fffb-41c0-85e6-8e5ab3673c32 tempest-VolumesGetTestJSON-1086945885 tempest-VolumesGetTestJSON-1086945885-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854" status: 404 len: 109 microversion: 2.1 time: 0.080540 May 12 18:59:22.752432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 6/7] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 18:59:22 2022] GET /compute/v2.1/os-volumes/07b11c54-7c6e-47ee-92ec-bbe1117b1854 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 18:59:23.569561 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 18:59:23.572619 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 18:59:23.574365 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 18:59:23.574804 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 18:59:23.578335 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 18:59:23.643576 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:23.666030 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:23.679248 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:23.684157 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:23.885257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Getting quotas for project 61be60da66374c5b9c064eefb5b54dfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:23.895993 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Getting quotas for user 6dfc6f930dea4e83a4fc58c9b02276f6 and project 61be60da66374c5b9c064eefb5b54dfe. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:23.921935 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 18:59:23.942614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 18:59:24.201639 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b8ec740f-2ae6-470e-8cbf-d6d6d671f5cb tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.698212 May 12 18:59:24.202874 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 2/8] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 18:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 18:59:24.220720 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5c6cb60d-10a9-49be-99f6-face76d219d2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:24.222148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5c6cb60d-10a9-49be-99f6-face76d219d2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:24.701303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5c6cb60d-10a9-49be-99f6-face76d219d2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:24.739642 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5c6cb60d-10a9-49be-99f6-face76d219d2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1214 microversion: 2.1 time: 0.525225 May 12 18:59:24.742269 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 7/9] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:24 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1214 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:25.764475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-635fa50a-5c3a-409a-a27d-6177193d85a9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:25.765179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-635fa50a-5c3a-409a-a27d-6177193d85a9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:26.566553 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-635fa50a-5c3a-409a-a27d-6177193d85a9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:26.612889 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-635fa50a-5c3a-409a-a27d-6177193d85a9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1214 microversion: 2.1 time: 0.858208 May 12 18:59:26.635110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 3/10] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:25 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1214 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:27.048386 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-aefa8a26-5089-470c-a95e-edbd363b5d9a tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Action: 'create', calling method: .version_select at 0x7f38c42efa60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940844177", "metadata": {"Type": "work"}}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-aefa8a26-5089-470c-a95e-edbd363b5d9a tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Request method failure captured: May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 121 May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkOhhZMMUcB7SSeecDCRytSjXVSTDLyzLZfqfLZknJCdaykiHPWw6edC02bEJoWOoERf7NAsFpvin8r1IlhxtfNqqrysBYc4bxPYcMYg06HsAsE7n6LEIebx3IFnmN6pzGIiosj4gpsok_zTUR26KFDjgtLhvIN92L9LRvYD8zBUNY May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 18:59:27.075987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73241efbb4d6484b93830c9a3797f925", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 88ac5f3b1be04fd4875be5dee14ba7f8 May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940844177", "metadata": {"Type": "work"}}} May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 18:59:27.077125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-940844177', 'metadata': {'Type': 'work'}}}} May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise error May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi '#$%' May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:59:27.077834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 18:59:27.078876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 18:59:27.079797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 18:59:27.079797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.082535 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-aefa8a26-5089-470c-a95e-edbd363b5d9a tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:59:27.083392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-aefa8a26-5089-470c-a95e-edbd363b5d9a tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.376344 May 12 18:59:27.088700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 8/11] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 12 18:59:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 18:59:27.093738 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b5d298da-4c8e-4c95-afa1-2865002d3c57 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Action: 'create', calling method: .version_select at 0x7f38c430b430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2015156445", "metadata": {"Type": "work"}}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b5d298da-4c8e-4c95-afa1-2865002d3c57 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Request method failure captured: May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 120 May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkOhhZMMUcB7SSeecDCRytSjXVSTDLyzLZfqfLZknJCdaykiHPWw6edC02bEJoWOoERf7NAsFpvin8r1IlhxtfNqqrysBYc4bxPYcMYg06HsAsE7n6LEIebx3IFnmN6pzGIiosj4gpsok_zTUR26KFDjgtLhvIN92L9LRvYD8zBUNY May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 18:59:27.097781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73241efbb4d6484b93830c9a3797f925", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 88ac5f3b1be04fd4875be5dee14ba7f8 May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2015156445", "metadata": {"Type": "work"}}} May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: May 12 18:59:27.098838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2015156445', 'metadata': {'Type': 'work'}}}} May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise error May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi '0' May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:59:27.099547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 18:59:27.107436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 18:59:27.109718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 18:59:27.109718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.109718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b5d298da-4c8e-4c95-afa1-2865002d3c57 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:59:27.109718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b5d298da-4c8e-4c95-afa1-2865002d3c57 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009379 May 12 18:59:27.109718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 4/12] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 12 18:59:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 18:59:27.110145 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c4446873-8b64-4c79-973e-7a21b37fe904 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Action: 'create', calling method: .version_select at 0x7f38c42bb790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-769600191", "metadata": {"Type": "work"}}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c4446873-8b64-4c79-973e-7a21b37fe904 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Request method failure captured: May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 118 May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkOhhZMMUcB7SSeecDCRytSjXVSTDLyzLZfqfLZknJCdaykiHPWw6edC02bEJoWOoERf7NAsFpvin8r1IlhxtfNqqrysBYc4bxPYcMYg06HsAsE7n6LEIebx3IFnmN6pzGIiosj4gpsok_zTUR26KFDjgtLhvIN92L9LRvYD8zBUNY May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 18:59:27.122855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73241efbb4d6484b93830c9a3797f925", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 88ac5f3b1be04fd4875be5dee14ba7f8 May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-769600191", "metadata": {"Type": "work"}}} May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 18:59:27.124060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-769600191', 'metadata': {'Type': 'work'}}}} May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise error May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi '' May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:59:27.124809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 18:59:27.125994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 18:59:27.128236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 18:59:27.128236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.131623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c4446873-8b64-4c79-973e-7a21b37fe904 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:59:27.139662 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c4446873-8b64-4c79-973e-7a21b37fe904 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032592 May 12 18:59:27.140912 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 9/13] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 12 18:59:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 18:59:27.150553 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-46ec8b91-2be2-43b9-a8c6-e120c156222b tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Calling method '.version_select at 0x7f38c31c4f70>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:27.217740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-46ec8b91-2be2-43b9-a8c6-e120c156222b tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] HTTP exception thrown: Volume tempest-invalid-128971248 could not be found. May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-46ec8b91-2be2-43b9-a8c6-e120c156222b tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Request method failure captured: May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-128971248 HTTP/1.1 May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkOhhZMMUcB7SSeecDCRytSjXVSTDLyzLZfqfLZknJCdaykiHPWw6edC02bEJoWOoERf7NAsFpvin8r1IlhxtfNqqrysBYc4bxPYcMYg06HsAsE7n6LEIebx3IFnmN6pzGIiosj4gpsok_zTUR26KFDjgtLhvIN92L9LRvYD8zBUNY May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 18:59:27.222381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73241efbb4d6484b93830c9a3797f925", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 88ac5f3b1be04fd4875be5dee14ba7f8 May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Volume tempest-invalid-128971248 could not be found. May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'tempest-invalid-128971248'} May 12 18:59:27.223618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-128971248 could not be found. (HTTP 404) (Request-ID: req-c6bed644-e0b7-42d9-9de2-7c9014afc1d8) May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.224371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 18:59:27.225569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-128971248 could not be found. May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 18:59:27.226564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-128971248 could not be found. May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-128971248 could not be found. May 12 18:59:27.228324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 18:59:27.230707 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-46ec8b91-2be2-43b9-a8c6-e120c156222b tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Returning 404 to user: Volume tempest-invalid-128971248 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:59:27.231821 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-46ec8b91-2be2-43b9-a8c6-e120c156222b tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-128971248" status: 404 len: 98 microversion: 2.1 time: 0.085780 May 12 18:59:27.232563 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 5/14] 10.222.0.48 () {58 vars in 1214 bytes} [Thu May 12 18:59:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-128971248 => generated 98 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 12 18:59:27.244452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-44b50910-d21c-435c-8270-203da4e798bd tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005399 May 12 18:59:27.245575 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 10/15] 10.222.0.48 () {58 vars in 1139 bytes} [Thu May 12 18:59:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 18:59:27.263115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f7ed76a7-1d8b-4ee8-a5ef-0d9dfb9e1b9e tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011683 May 12 18:59:27.266001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 6/16] 10.222.0.48 () {58 vars in 1136 bytes} [Thu May 12 18:59:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 18:59:27.281170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8da5a497-efa7-4f5b-916f-ce394e214640 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Calling method '.version_select at 0x7f38c425e820>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:27.356154 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-8da5a497-efa7-4f5b-916f-ce394e214640 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] HTTP exception thrown: Volume 0f81751c-0b65-4c77-a456-6872eafbcca3 could not be found. May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8da5a497-efa7-4f5b-916f-ce394e214640 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Request method failure captured: May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/os-volumes/0f81751c-0b65-4c77-a456-6872eafbcca3 HTTP/1.1 May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkOhhZMMUcB7SSeecDCRytSjXVSTDLyzLZfqfLZknJCdaykiHPWw6edC02bEJoWOoERf7NAsFpvin8r1IlhxtfNqqrysBYc4bxPYcMYg06HsAsE7n6LEIebx3IFnmN6pzGIiosj4gpsok_zTUR26KFDjgtLhvIN92L9LRvYD8zBUNY May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 18:59:27.360029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73241efbb4d6484b93830c9a3797f925", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 88ac5f3b1be04fd4875be5dee14ba7f8 May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Volume 0f81751c-0b65-4c77-a456-6872eafbcca3 could not be found. May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '0f81751c-0b65-4c77-a456-6872eafbcca3'} May 12 18:59:27.361179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f81751c-0b65-4c77-a456-6872eafbcca3 could not be found. (HTTP 404) (Request-ID: req-9772b085-e723-444f-b464-9a1ef20eeeb4) May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.361934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 18:59:27.362805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f81751c-0b65-4c77-a456-6872eafbcca3 could not be found. May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 18:59:27.363702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f81751c-0b65-4c77-a456-6872eafbcca3 could not be found. May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f81751c-0b65-4c77-a456-6872eafbcca3 could not be found. May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8da5a497-efa7-4f5b-916f-ce394e214640 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Returning 404 to user: Volume 0f81751c-0b65-4c77-a456-6872eafbcca3 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8da5a497-efa7-4f5b-916f-ce394e214640 tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/0f81751c-0b65-4c77-a456-6872eafbcca3" status: 404 len: 109 microversion: 2.1 time: 0.092404 May 12 18:59:27.364612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 11/17] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 18:59:27 2022] DELETE /compute/v2.1/os-volumes/0f81751c-0b65-4c77-a456-6872eafbcca3 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 18:59:27.373918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-66f24d3b-9a8d-44ec-b7b8-eb1d7de0b9de tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Calling method '.version_select at 0x7f38c42bb5e0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:27.422658 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-66f24d3b-9a8d-44ec-b7b8-eb1d7de0b9de tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] HTTP exception thrown: Volume 66738c63-2715-4267-b698-203f9539f802 could not be found. May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-66f24d3b-9a8d-44ec-b7b8-eb1d7de0b9de tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Request method failure captured: May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/os-volumes/66738c63-2715-4267-b698-203f9539f802 HTTP/1.1 May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkOhhZMMUcB7SSeecDCRytSjXVSTDLyzLZfqfLZknJCdaykiHPWw6edC02bEJoWOoERf7NAsFpvin8r1IlhxtfNqqrysBYc4bxPYcMYg06HsAsE7n6LEIebx3IFnmN6pzGIiosj4gpsok_zTUR26KFDjgtLhvIN92L9LRvYD8zBUNY May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 18:59:27.432640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73241efbb4d6484b93830c9a3797f925", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73241efbb4d6484b93830c9a3797f925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 73241efbb4d6484b93830c9a3797f925 May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesNegativeTest-967838910 May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 88ac5f3b1be04fd4875be5dee14ba7f8 May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesNegativeTest-967838910-project May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Volume 66738c63-2715-4267-b698-203f9539f802 could not be found. May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '66738c63-2715-4267-b698-203f9539f802'} May 12 18:59:27.433932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66738c63-2715-4267-b698-203f9539f802 could not be found. (HTTP 404) (Request-ID: req-af2a0b71-868c-4b04-b606-997b4b6af625) May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.434667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 18:59:27.435850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66738c63-2715-4267-b698-203f9539f802 could not be found. May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 18:59:27.436926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66738c63-2715-4267-b698-203f9539f802 could not be found. May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66738c63-2715-4267-b698-203f9539f802 could not be found. May 12 18:59:27.438102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 18:59:27.442418 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-66f24d3b-9a8d-44ec-b7b8-eb1d7de0b9de tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] Returning 404 to user: Volume 66738c63-2715-4267-b698-203f9539f802 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 18:59:27.443312 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-66f24d3b-9a8d-44ec-b7b8-eb1d7de0b9de tempest-VolumesNegativeTest-967838910 tempest-VolumesNegativeTest-967838910-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/66738c63-2715-4267-b698-203f9539f802" status: 404 len: 109 microversion: 2.1 time: 0.074836 May 12 18:59:27.445109 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9bc27e9a-62ad-4659-82d8-b6f018c91cdf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'create', calling method: .version_select at 0x7f38c31839d0>, body: {"keypair": {"name": "tempest-keypair-215958706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7ZeszESe7Oo6jNRlbvZqAl1M7YqILeMq++0yTH2SQC7vZZYt3l+tZhPhJ8ND/gTnUQwpJb7FziQg1GJvW8RLcPRqLysTdc2xEKL0PsmAmtMiHmx8MGREuKVuvocLvzrg=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:27.459474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 12/18] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 18:59:27 2022] GET /compute/v2.1/os-volumes/66738c63-2715-4267-b698-203f9539f802 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 18:59:27.510497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-9bc27e9a-62ad-4659-82d8-b6f018c91cdf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:27.522817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-9bc27e9a-62ad-4659-82d8-b6f018c91cdf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for user 2c202a7f2c484cd3b0363b75c1a673a3 and project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:27.607687 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9bc27e9a-62ad-4659-82d8-b6f018c91cdf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.289414 May 12 18:59:27.608496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 7/19] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 18:59:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 18:59:27.634479 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:27.635568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:27.675026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:27.680205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:27.681225 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:27.681708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:28.393781 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:28.419704 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a373d9bd-54b9-4c21-af9e-2224f996722f tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1274 microversion: 2.1 time: 0.791566 May 12 18:59:28.420308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 13/20] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:27 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1274 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:29.439730 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:29.440270 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:29.454353 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:29.456035 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:29.461129 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:29.464158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:30.027903 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:30.056607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-54cad81c-cf01-49ee-b735-adae5f798e97 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1272 microversion: 2.1 time: 0.621896 May 12 18:59:30.057201 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 8/21] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:29 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1272 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:31.074416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:31.075027 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:31.082992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:31.090198 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:31.091085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:31.091647 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:31.725951 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:31.748336 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d9b7823b-f2d8-48a6-aa29-d9ac21402900 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1272 microversion: 2.1 time: 0.665129 May 12 18:59:31.752738 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 14/22] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:31 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1272 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:32.766061 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:32.767442 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:32.776374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:32.778153 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:32.781013 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:32.782960 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:33.284876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:33.297884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7511b535-bffd-40e8-a332-6b742426ec45 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1272 microversion: 2.1 time: 0.535948 May 12 18:59:33.298791 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 9/23] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:32 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1272 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:34.154434 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1c2d5c21-e296-47cd-999a-ea8fb5aedb45 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: .version_select at 0x7f38c42bb3a0>, body: {"keypair": {"name": "tempest-keypair-991571828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYWjvJcVqJZ7UizkMVL9L/FXK0gq7YFd/3sP1VMgmfXqA8Mpbv+8aeRuD6xPNjh2xZ4oz2/9HzDvNROC/BJ3HaZ60wHjfyKObEh9oQH+dpD95oNpO2Cv0mFA7MPpc5OA=="}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:34.315696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:34.316385 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:34.346312 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:34.347160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:34.355521 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:34.355993 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:34.450156 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-1c2d5c21-e296-47cd-999a-ea8fb5aedb45 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:34.478984 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-1c2d5c21-e296-47cd-999a-ea8fb5aedb45 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:34.628509 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1c2d5c21-e296-47cd-999a-ea8fb5aedb45 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.885383 May 12 18:59:34.649168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 15/24] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 18:59:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:35.363968 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:35.379809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-355d79bd-5e2f-43ac-9efb-2f0a7a66fd82 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 1.065802 May 12 18:59:35.380468 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 10/25] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:34 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:59:36.398869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:36.399504 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:36.415972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:36.416437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:36.426300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:36.428158 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:37.187219 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:37.204372 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6222f201-9599-4dc4-ac66-12db3c139695 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.811425 May 12 18:59:37.207140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 16/26] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:36 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:38.223424 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:38.226123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:38.236719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-867998674", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:38.252233 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:38.252694 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:38.253492 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:38.254036 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:38.394730 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] validate_networks() for [('6591bd39-6d3d-40fe-a449-357cebc4a65e', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 18:59:39.535100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:39.545958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-cf1cce12-0d1d-4220-8cbf-4dbdaed231a2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 1.328297 May 12 18:59:39.555001 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 17/27] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:38 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:40.345770 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 18:59:40.348067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 18:59:40.348067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 18:59:40.348067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 18:59:40.348067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 18:59:40.371329 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:40.371728 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:40.372540 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:40.372979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:40.446968 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for project eb2e124562e34719a49be3de45e6cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:40.462419 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for user 1df4257419c4434fa22edb0805c1a204 and project eb2e124562e34719a49be3de45e6cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:40.496884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 18:59:40.509255 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 18:59:40.571828 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:40.575567 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:40.602001 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:40.602720 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:40.603515 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:40.603996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:40.721362 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4f05bea8-faf9-4782-85cc-5fc28020542e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.850380 May 12 18:59:40.730325 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 11/28] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 18:59:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 18:59:40.766440 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-75b0f49c-107d-44cf-b3f6-ba0289616dd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:40.767202 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-75b0f49c-107d-44cf-b3f6-ba0289616dd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:41.299980 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-75b0f49c-107d-44cf-b3f6-ba0289616dd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:41.312359 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-75b0f49c-107d-44cf-b3f6-ba0289616dd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1221 microversion: 2.1 time: 0.577341 May 12 18:59:41.314046 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 12/29] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:40 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1221 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:41.515064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1604201164", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dc5243f-8a82-4161-97c5-4250a7dc2b56"}], "security_groups": [{"name": "tempest-securitygroup--1985400350"}], "key_name": "tempest-keypair-215958706", "user_data": "}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:41.801211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:41.813196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f3776f1a-772c-416e-9bad-8c3d72029dd9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 1.245565 May 12 18:59:41.830324 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 18/30] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:40 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:59:41.837135 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2044394834", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:42.053548 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] validate_networks() for [('3dc5243f-8a82-4161-97c5-4250a7dc2b56', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 18:59:42.066470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] validate_networks() for [('6591bd39-6d3d-40fe-a449-357cebc4a65e', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 18:59:44.501686 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 18:59:44.502209 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 18:59:44.502770 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 18:59:44.503249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 18:59:44.504467 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 18:59:44.521483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:44.525756 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:44.527115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:44.527995 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:44.579197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:44.588118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for user 2c202a7f2c484cd3b0363b75c1a673a3 and project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:44.638962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 18:59:44.649339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 18:59:44.854469 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 18:59:44.854965 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 18:59:44.855553 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 18:59:44.856205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 18:59:44.856867 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 18:59:44.875743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:44.876613 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-88ca956a-b348-4b61-b883-16216bab6ae4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.362053 May 12 18:59:44.877162 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:44.877925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 13/31] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 18:59:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 3369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 18:59:44.884748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:44.886207 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:44.967805 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for project eb2e124562e34719a49be3de45e6cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:44.974410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for user 1df4257419c4434fa22edb0805c1a204 and project eb2e124562e34719a49be3de45e6cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:45.021402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 18:59:45.024581 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 18:59:45.404256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3371079d-6a9d-4121-bfa1-b1e2834042dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.572738 May 12 18:59:45.405018 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 19/32] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 18:59:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 3574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 18:59:45.419731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:45.423078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:45.462594 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:45.463750 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:45.466011 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:45.467399 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:45.628789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-6a02e2bd-820e-40a4-a35a-01fea5cec326 req-d447f21f-78da-4b18-b3c0-db9908e223d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10655ce7-9ca0-49c7-b182-0d2447b6c93c", "tag": "d1c66529-6b79-49ae-a06f-387cfa61a5ad"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:45.723125 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-6a02e2bd-820e-40a4-a35a-01fea5cec326 req-d447f21f-78da-4b18-b3c0-db9908e223d2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:45.723638 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-6a02e2bd-820e-40a4-a35a-01fea5cec326 req-d447f21f-78da-4b18-b3c0-db9908e223d2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:45.809835 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-6a02e2bd-820e-40a4-a35a-01fea5cec326 req-d447f21f-78da-4b18-b3c0-db9908e223d2 service nova] Creating event network-changed:d1c66529-6b79-49ae-a06f-387cfa61a5ad for instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c on hv-cinder-79575 May 12 18:59:45.810815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-6a02e2bd-820e-40a4-a35a-01fea5cec326 req-d447f21f-78da-4b18-b3c0-db9908e223d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 18:59:45.812132 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ea5191e-c533-4041-bf49-b5f1fa6a199d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:45.812736 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ea5191e-c533-4041-bf49-b5f1fa6a199d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:45.813734 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ea5191e-c533-4041-bf49-b5f1fa6a199d None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:45.814340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ea5191e-c533-4041-bf49-b5f1fa6a199d None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:45.835149 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.compute.rpcapi [None req-7ea5191e-c533-4041-bf49-b5f1fa6a199d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 18:59:45.836257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ea5191e-c533-4041-bf49-b5f1fa6a199d None None] Releasing lock "compute-rpcapi-router" {{(pid=117101) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 18:59:45.919070 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7ea5191e-c533-4041-bf49-b5f1fa6a199d None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.035257 May 12 18:59:45.920188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 14/33] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 18:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:45.986754 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:45.994285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-20e04cfe-38ca-45e5-93b4-8ca733da81db tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.581627 May 12 18:59:45.998977 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 20/34] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:45 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:46.016191 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-95ad3984-1340-4131-91d0-b353a52fdf2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:46.017271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-95ad3984-1340-4131-91d0-b353a52fdf2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:46.164560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-95ad3984-1340-4131-91d0-b353a52fdf2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:46.178017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-95ad3984-1340-4131-91d0-b353a52fdf2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1237 microversion: 2.1 time: 0.174401 May 12 18:59:46.179454 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 21/35] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:45 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1237 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:46.207861 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c3e18618-8627-4fae-b245-be955e28376f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:46.208557 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c3e18618-8627-4fae-b245-be955e28376f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:46.251369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b63dea26-89e4-4de2-b764-df6c0fa41939 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'create', calling method: .version_select at 0x7f38c28b4ca0>, body: {"keypair": {"name": "tempest-keypair-982289218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGpRtVUsdP0FQDnzZUhMIvAWjt283JKUvw1QQqvca9jw2KNbuFunXlTG5OGHgSrM17Exh6FmaZ+TplgLPlZuzhGiMQxXwkS0obHo+Ln5acJ6XhS56pWwICHKjjrYmz9uw=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:46.299673 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-b63dea26-89e4-4de2-b764-df6c0fa41939 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:46.311779 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-b63dea26-89e4-4de2-b764-df6c0fa41939 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for user 803b29a8c5e34ef0993913c0b08ccfd1 and project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:46.371871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c3e18618-8627-4fae-b245-be955e28376f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:46.378716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b63dea26-89e4-4de2-b764-df6c0fa41939 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.457193 May 12 18:59:46.393931 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 15/36] 10.222.0.48 () {62 vars in 1199 bytes} [Thu May 12 18:59:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 473 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 18:59:46.409790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1142440539", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b"}], "security_groups": [{"name": "tempest-securitygroup--1345582703"}], "key_name": "tempest-keypair-991571828", "user_data": "}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:46.413892 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c3e18618-8627-4fae-b245-be955e28376f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1222 microversion: 2.1 time: 0.219901 May 12 18:59:46.416766 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 22/37] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:46 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:46.642110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] validate_networks() for [('5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 18:59:47.013001 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:47.016424 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:47.032363 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.034259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.036811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.043178 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.361219 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:47.370496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a1fa658b-4eb1-448f-8a55-3548a7a467f0 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.361869 May 12 18:59:47.377379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 23/38] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:47 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:59:47.383173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:47.389137 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:47.403932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.404761 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.405798 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.406477 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.524723 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 18:59:47.525470 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 18:59:47.526012 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 18:59:47.526606 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 18:59:47.527099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 18:59:47.545022 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.548882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.551114 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.552010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.596083 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:47.603605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-370c5456-47dc-459d-9d71-b620e023fdeb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1241 microversion: 2.1 time: 0.224831 May 12 18:59:47.605213 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 24/39] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:47 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1241 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:47.614447 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:47.614749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:47.614749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:47.621554 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.623182 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:47.625964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.626893 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:47.627551 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:47.650459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 18:59:47.656610 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 18:59:47.693638 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:47.700945 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-94bccbf6-081a-4049-889e-e118b4c7c024 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1226 microversion: 2.1 time: 0.094542 May 12 18:59:47.701555 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 25/40] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:47 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:47.752000 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bf75769b-7676-45e3-9b87-0b1b96699194 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.356894 May 12 18:59:47.753078 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 16/41] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 18:59:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 18:59:47.763289 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3ecf5b65-f2e5-4eaf-9724-5284d39cc57c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:47.764166 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3ecf5b65-f2e5-4eaf-9724-5284d39cc57c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:47.836843 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ecf5b65-f2e5-4eaf-9724-5284d39cc57c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:47.844331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3ecf5b65-f2e5-4eaf-9724-5284d39cc57c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1241 microversion: 2.1 time: 0.083748 May 12 18:59:47.866394 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 26/42] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:47 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:48.397266 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:48.398330 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:48.406087 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.407039 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.407930 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.408451 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.579392 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:48.587411 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1401555f-4119-4c13-a315-85c3d0164d4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.197414 May 12 18:59:48.589854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 17/43] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:48 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:48.623566 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:48.624663 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:48.636028 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.636496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.639236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.650002 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.719972 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:48.720628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:48.730083 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.730764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.731727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.733104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.733759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:48.743443 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-53a4923c-9fe6-4577-b32d-05d707a51f5b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1241 microversion: 2.1 time: 0.124853 May 12 18:59:48.754140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 27/44] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:48 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:48.767275 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1232018235", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5a4fc0e-0042-4201-aa54-6b150376479a"}], "security_groups": [{"name": "tempest-securitygroup--1885561792"}], "key_name": "tempest-keypair-982289218", "user_data": "}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:48.879167 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:48.892738 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-80c6e776-2d2a-4534-b9e2-d45e325bd865 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1226 microversion: 2.1 time: 0.178419 May 12 18:59:48.903544 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 18/45] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:48 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1226 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:48.909975 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:48.911713 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:48.930810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.931465 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.933708 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:48.936289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:48.968159 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] validate_networks() for [('a5a4fc0e-0042-4201-aa54-6b150376479a', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 18:59:49.107015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:49.115781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-cb8a9a36-880b-4fc4-a026-a6811fad21b7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1237 microversion: 2.1 time: 0.220120 May 12 18:59:49.116383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 19/46] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:48 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1237 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:49.428097 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 18:59:49.428524 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 18:59:49.429006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 18:59:49.429419 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 18:59:49.429898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 18:59:49.438152 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.438601 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.439401 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.439837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.455601 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 18:59:49.459966 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for user 803b29a8c5e34ef0993913c0b08ccfd1 and project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 18:59:49.470536 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 18:59:49.472626 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 18:59:49.517997 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e9b89ecd-a4d0-4b58-acfb-18b33fa941ae tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.755141 May 12 18:59:49.518755 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 28/47] 10.222.0.48 () {62 vars in 1187 bytes} [Thu May 12 18:59:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 18:59:49.529384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-784f4d2a-bd90-4e31-804f-1423e4e90d87 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:49.530098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-784f4d2a-bd90-4e31-804f-1423e4e90d87 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:49.583880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-784f4d2a-bd90-4e31-804f-1423e4e90d87 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:49.590880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-784f4d2a-bd90-4e31-804f-1423e4e90d87 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:49.592438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-784f4d2a-bd90-4e31-804f-1423e4e90d87 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:49.593565 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-784f4d2a-bd90-4e31-804f-1423e4e90d87 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1281 microversion: 2.20 time: 0.068424 May 12 18:59:49.594246 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 20/48] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:49 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 18:59:49.605518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:49.606161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:49.612841 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.613389 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.614125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.614572 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.759236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:49.763946 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:49.764573 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:49.767475 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-eba3d2cb-8d00-4829-bb4a-a3dd9fe8470a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.165714 May 12 18:59:49.768247 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 29/49] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:49 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:49.771700 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.772155 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.773088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.773725 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.836661 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:49.843912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-18abd6fb-28de-4846-adba-ef8c9689c26d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1233 microversion: 2.1 time: 0.083656 May 12 18:59:49.844482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 21/50] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:49 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:49.910124 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:49.910766 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:49.916986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.917438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.918241 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:49.918682 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:49.979105 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:49.988962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-99ad9df4-6029-465a-9fef-3fdd028931ac tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1218 microversion: 2.1 time: 0.082598 May 12 18:59:49.990300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 30/51] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:49 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:50.133049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:50.133695 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:50.139810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.140268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.141056 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.141639 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.205900 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:50.216344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b8843998-8d24-4600-bc1a-ba8b7035b006 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1293 microversion: 2.1 time: 0.087846 May 12 18:59:50.217104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 22/52] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:50 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:50.611546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:50.612167 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:50.617986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.618446 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.619218 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.619664 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.681146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:50.689338 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:50.690902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:50.692004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e2330a30-8d02-45a7-94a9-25dfa7157edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1285 microversion: 2.20 time: 0.084377 May 12 18:59:50.693139 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 31/53] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:50 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:59:50.785625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:50.786256 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:50.793026 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.793578 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.794473 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.794987 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.868222 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:50.868828 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:50.895267 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.896872 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.901901 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:50.902513 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:50.988694 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:50.990209 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:51.006023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a626b893-cf78-4840-a43f-d728e4f07d41 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.224472 May 12 18:59:51.007013 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 23/54] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:50 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:51.012496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:51.013489 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:51.023115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:51.023385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9a7ebf7f-ac6b-4c4c-b602-34901a886e73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1233 microversion: 2.1 time: 0.158704 May 12 18:59:51.024161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 32/55] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:50 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1233 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:51.034992 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:51.036820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:51.037604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:51.108435 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:51.116690 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3a44622b-9c8d-4ffe-a604-effd43aeb0cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1218 microversion: 2.1 time: 0.108579 May 12 18:59:51.117267 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 24/56] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:51 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:51.234215 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:51.234777 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:51.241216 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:51.241693 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:51.242453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:51.242885 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:51.302622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:51.310066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1782b249-bc5c-4e2b-a2e8-ed437a44c628 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1293 microversion: 2.1 time: 0.079739 May 12 18:59:51.310633 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 33/57] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:51 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:51.710890 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:51.711516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:51.717375 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:51.717871 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:51.718662 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:51.719084 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:51.783502 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:51.792187 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:51.793763 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:51.801943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-59c58166-2bd1-4bbe-bad8-86c37e70d7cf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1277 microversion: 2.20 time: 0.088420 May 12 18:59:51.801943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 25/58] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:51 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:59:52.026628 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:52.028348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:52.034852 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.036956 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.037861 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.038424 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.042178 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:52.042808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:52.057324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.058063 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.059112 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.059565 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.199508 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:52.213291 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-eac2aa30-d775-46e9-9eee-493e86e2fc27 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1233 microversion: 2.1 time: 0.175153 May 12 18:59:52.214134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 26/59] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:52 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1233 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:52.218860 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:52.223845 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:52.231804 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.232257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.233039 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.233645 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.434401 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:52.443159 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1ae1d618-a744-4292-af10-24862fef5e4a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.424196 May 12 18:59:52.445490 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 34/60] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:52 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:52.451560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:52.453038 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:52.456716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:52.463329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.463788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.465874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.467507 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.474117 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dba4d64d-c7bf-41e8-9af1-ec9af47ae691 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1274 microversion: 2.1 time: 0.258750 May 12 18:59:52.483851 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 27/61] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:52 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:52.552133 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:52.560432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-edad692c-1ac2-4f37-9bfe-82f77198ea81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1301 microversion: 2.1 time: 0.113580 May 12 18:59:52.561115 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 35/62] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:52 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1301 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:52.814137 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:52.815060 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:52.821911 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.822527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.823365 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:52.823795 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:52.889296 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:52.898005 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:52.899673 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:52.900772 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1533a3b7-f6f3-465f-bca0-6729005cf3bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1277 microversion: 2.20 time: 0.092270 May 12 18:59:52.901653 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 28/63] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:52 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:59:53.230858 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:53.231618 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:53.238379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.238909 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.239750 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.240276 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.318153 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:53.325973 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b0aee169-6fcb-459f-94e4-ecbfa65b7690 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1233 microversion: 2.1 time: 0.098693 May 12 18:59:53.326742 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 36/64] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:53 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1233 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:59:53.464500 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:53.465115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:53.471126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.471615 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.472403 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.472845 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.491177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:53.492008 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:53.498640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.499393 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.501080 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.501732 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.631240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:53.640855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-fb2065ac-6a6d-486c-9842-f8550fcb196a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1274 microversion: 2.1 time: 0.153645 May 12 18:59:53.641597 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 37/65] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:53 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:53.653018 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:53.653986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:53.672146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.673849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.674864 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.675514 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.858524 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:53.878208 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9f9c2864-3d15-4486-92aa-12722167d31d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1311 microversion: 2.1 time: 0.235707 May 12 18:59:53.895441 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 38/66] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:53 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:53.923242 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:53.925039 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:53.938097 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.940803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.947896 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:53.949353 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:53.958519 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:53.966129 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5a87c1e4-544c-4417-9203-605fcbc1be98 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.505270 May 12 18:59:53.971181 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 29/67] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:53 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:54.081807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:54.086025 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:54.087588 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:54.089165 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1a22fb57-93b0-4e26-9b06-2712621cdca3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1333 microversion: 2.20 time: 0.172606 May 12 18:59:54.104360 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 39/68] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:53 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1333 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 18:59:54.345227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:54.346472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:54.361613 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:54.361912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:54.365496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:54.367429 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:54.470460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:54.480691 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-603581ee-4846-4b42-bbca-7271fd04c9e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1297 microversion: 2.1 time: 0.141018 May 12 18:59:54.486496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 30/69] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:54 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1297 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:54.672640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:54.677071 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:54.705866 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:54.708316 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:54.710851 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:54.719036 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:54.876582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:54.887898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2a711cc9-18e9-48bd-96de-4181f29caf2a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1280 microversion: 2.1 time: 0.233081 May 12 18:59:54.890429 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 40/70] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:54 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1280 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:54.899673 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:54.900260 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:54.914751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:54.915199 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:54.915972 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:54.916658 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:54.983116 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:54.984213 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:55.005640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.006817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:55.008288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.009373 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:55.209010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:55.218992 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2c82ea04-434c-409f-bdfb-07a03d6344c7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1299 microversion: 2.1 time: 0.321697 May 12 18:59:55.221127 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 31/71] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:54 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:55.234023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:55.234787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:55.250240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.250700 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:55.251518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.252044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:55.414036 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:55.422161 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:55.423641 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:55.424736 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a8fef85c-cdb1-4750-9a34-d6f6a6bdb62c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1339 microversion: 2.20 time: 0.202431 May 12 18:59:55.425283 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 32/72] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:55 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:59:55.507483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:55.508792 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:55.518012 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.518735 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:55.521287 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.521965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:55.843115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:55.845958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:55.863733 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-221c41a6-ae2f-48d2-b904-4154c7747933 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1295 microversion: 2.1 time: 0.361280 May 12 18:59:55.864495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 33/73] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:55 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1295 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:59:55.880050 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-270a70e8-8c16-4404-805e-18ed768020c9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.900095 May 12 18:59:55.889120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 41/74] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:54 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:55.911409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:55.911942 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:55.927204 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.927664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:55.931429 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:55.933724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.062027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:56.074767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-cd75b56c-a2ee-4c44-a98c-f4c5903d92d7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1280 microversion: 2.1 time: 0.166953 May 12 18:59:56.077180 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 34/75] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:55 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:56.241134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:56.241858 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:56.251200 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.251949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.253137 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.254118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.423262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-dbfca454-ca5e-4496-bfcf-f2a7d4ed10eb req-de5d73d8-9145-437c-bde2-7d059c962d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1351fe24-18b4-4cb5-b54f-33595df43567", "tag": "892d0c20-1c89-4582-aee5-a3cc582f961d"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:56.469239 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-dbfca454-ca5e-4496-bfcf-f2a7d4ed10eb req-de5d73d8-9145-437c-bde2-7d059c962d38 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.470777 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-dbfca454-ca5e-4496-bfcf-f2a7d4ed10eb req-de5d73d8-9145-437c-bde2-7d059c962d38 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.479735 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:56.497676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-11a3d9bc-6dd2-4a80-a7cf-6b0c574131a2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1299 microversion: 2.1 time: 0.261534 May 12 18:59:56.502031 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 42/76] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:56 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1299 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:56.514550 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-dbfca454-ca5e-4496-bfcf-f2a7d4ed10eb req-de5d73d8-9145-437c-bde2-7d059c962d38 service nova] Creating event network-changed:892d0c20-1c89-4582-aee5-a3cc582f961d for instance 1351fe24-18b4-4cb5-b54f-33595df43567 on hv-cinder-79575 May 12 18:59:56.523375 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-dbfca454-ca5e-4496-bfcf-f2a7d4ed10eb req-de5d73d8-9145-437c-bde2-7d059c962d38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114478 May 12 18:59:56.524250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 35/77] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 18:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:56.533120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:56.538960 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:56.565911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.566552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.568573 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.570231 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.812775 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:56.837945 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:56.841688 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:56.844126 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-febc3aff-fd9e-451e-812d-d13c93d54ecf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1339 microversion: 2.20 time: 0.328758 May 12 18:59:56.845473 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 43/78] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:56 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1339 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:59:56.881572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:56.882490 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:56.890638 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.891546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.892484 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.893069 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.916731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:56.917442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:56.936870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.937294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:56.938892 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:56.939554 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:57.158810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:57.173081 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-77a9fb70-251b-4b0b-bca9-a981131f8f73 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1295 microversion: 2.1 time: 0.295807 May 12 18:59:57.173700 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 36/79] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:56 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1295 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:57.178168 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:57.178778 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:57.195098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:57.198066 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:57.202671 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:57.204701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:57.983068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:57.991121 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-66b093f5-ff69-4aa3-a993-f25353a65451 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.816405 May 12 18:59:57.991699 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 37/80] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:57 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:57.996359 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:57.996962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:58.006999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.007424 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.020955 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.021665 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.056424 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:58.066092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e117fa68-63e0-43c0-b5ec-59f74552543b tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 1.164408 May 12 18:59:58.070461 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 44/81] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:56 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 18:59:58.237594 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-b4b9b79a-5ae1-4b45-8dde-01be704597fa req-c2a2b2dd-9555-4034-9d94-e6a65974d686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10655ce7-9ca0-49c7-b182-0d2447b6c93c", "name": "network-vif-plugged", "status": "completed", "tag": "d1c66529-6b79-49ae-a06f-387cfa61a5ad"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:58.282808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b4b9b79a-5ae1-4b45-8dde-01be704597fa req-c2a2b2dd-9555-4034-9d94-e6a65974d686 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.283292 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b4b9b79a-5ae1-4b45-8dde-01be704597fa req-c2a2b2dd-9555-4034-9d94-e6a65974d686 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.340259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-b4b9b79a-5ae1-4b45-8dde-01be704597fa req-c2a2b2dd-9555-4034-9d94-e6a65974d686 service nova] Creating event network-vif-plugged:d1c66529-6b79-49ae-a06f-387cfa61a5ad for instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c on hv-cinder-79575 May 12 18:59:58.341554 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b4b9b79a-5ae1-4b45-8dde-01be704597fa req-c2a2b2dd-9555-4034-9d94-e6a65974d686 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 18:59:58.342775 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-360bc217-d310-4344-80c8-408fdb0103be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.343379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-360bc217-d310-4344-80c8-408fdb0103be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.344465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-360bc217-d310-4344-80c8-408fdb0103be None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.345140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-360bc217-d310-4344-80c8-408fdb0103be None None] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.357081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.compute.rpcapi [None req-360bc217-d310-4344-80c8-408fdb0103be None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 18:59:58.358502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-360bc217-d310-4344-80c8-408fdb0103be None None] Releasing lock "compute-rpcapi-router" {{(pid=117102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 18:59:58.389291 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-360bc217-d310-4344-80c8-408fdb0103be None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311179 May 12 18:59:58.395924 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 45/82] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 18:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:58.403273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:58.404141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:58.414420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.415102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.415936 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.416782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.522347 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:58.531146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:58.533361 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:58.534946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e3f7ab35-be93-4077-8882-f2d689a77231 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1339 microversion: 2.20 time: 0.137396 May 12 18:59:58.536403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 46/83] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:58 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 18:59:58.553418 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:58.554366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:58.560817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.561267 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.562088 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.562524 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.603307 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:58.610899 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dcf1fff6-c2c6-4415-a7aa-dd6a84db1196 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.618110 May 12 18:59:58.611710 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 38/84] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:57 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:58.617344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-4e45750f-b18c-4954-8a95-867d7c06b26a req-b44d08b3-7495-400d-87d8-003df753aabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64bcf7c1-c1cd-4149-af79-39ad90968742", "tag": "1b6193bd-0c92-47cd-8e4c-4291685e61ee"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 18:59:58.626303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-4e45750f-b18c-4954-8a95-867d7c06b26a req-b44d08b3-7495-400d-87d8-003df753aabd service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:58.626740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-4e45750f-b18c-4954-8a95-867d7c06b26a req-b44d08b3-7495-400d-87d8-003df753aabd service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:58.639331 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-4e45750f-b18c-4954-8a95-867d7c06b26a req-b44d08b3-7495-400d-87d8-003df753aabd service nova] Creating event network-changed:1b6193bd-0c92-47cd-8e4c-4291685e61ee for instance 64bcf7c1-c1cd-4149-af79-39ad90968742 on hv-cinder-79575 May 12 18:59:58.644334 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-4e45750f-b18c-4954-8a95-867d7c06b26a req-b44d08b3-7495-400d-87d8-003df753aabd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031167 May 12 18:59:58.645994 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 39/85] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 18:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 18:59:59.026848 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:59.028773 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:59.055800 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.059176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:59.060165 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.061105 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:59.221335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:59.232311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7b5432b0-3396-4183-af6c-670f271a2f53 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.694385 May 12 18:59:59.234062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 47/86] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:58 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:59.244294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:59.245260 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:59.252047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.252860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:59.253910 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.255138 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:59.829499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:59.837390 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-44231473-6eec-48a6-aa51-f17750a3955b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.833306 May 12 18:59:59.838203 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 40/87] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:59 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:59.842550 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:59.843352 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:59.851095 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.851743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:59.852611 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.852942 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:59.907905 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 18:59:59.915702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0ead825d-47a5-4c09-9135-f88bd51adbe3 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.680110 May 12 18:59:59.916784 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 48/88] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:59 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 18:59:59.922220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 18:59:59.923081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 18:59:59.930908 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.931639 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 18:59:59.932726 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 18:59:59.933378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:00.478919 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:00.491360 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:00.493120 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:00.494536 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b8564c6f-8892-4431-b281-60e36d886a5c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.655511 May 12 19:00:00.496269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 41/89] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 18:59:59 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:00.501078 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:00.501834 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:00.511747 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:00.512451 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:00.513288 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:00.514547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:00.522862 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:00.532026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0108e7ad-f46a-4ea2-a892-dfb664547ab1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.613936 May 12 19:00:00.532740 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 49/90] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 18:59:59 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:00.855569 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:00.856436 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:00.867796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:00.867796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:00.870245 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:00.871918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:00.979982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:01.000795 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-12bcad86-a83f-4463-bfe4-f754f8d78eb5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.503199 May 12 19:00:01.024778 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 42/91] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:00 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:01.030682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:01.031620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:01.046980 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:01.047683 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:01.048931 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:01.050767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:01.474981 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:01.497745 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7d00f0c1-714e-49cf-8726-c6f2854c0596 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.635738 May 12 19:00:01.498499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 50/92] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:00 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:01.524583 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:01.532503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d3059077-6769-4031-a6d7-16d77c093726 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.515132 May 12 19:00:01.533301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 43/93] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:01 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:01.538858 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:01.539845 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:01.546669 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:01.547150 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:01.548125 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:01.548631 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:01.731845 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-ee362544-9483-4571-aa3d-a907617d202c req-31422a65-77ec-470b-82c6-46ea0178541f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398fab6a-ea82-46a2-907a-5c98b273d143", "tag": "48557972-00a2-459a-88df-83a565897bd6"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:01.742075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ee362544-9483-4571-aa3d-a907617d202c req-31422a65-77ec-470b-82c6-46ea0178541f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:01.742696 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ee362544-9483-4571-aa3d-a907617d202c req-31422a65-77ec-470b-82c6-46ea0178541f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:01.757925 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-ee362544-9483-4571-aa3d-a907617d202c req-31422a65-77ec-470b-82c6-46ea0178541f service nova] Creating event network-changed:48557972-00a2-459a-88df-83a565897bd6 for instance 398fab6a-ea82-46a2-907a-5c98b273d143 on hv-cinder-79575 May 12 19:00:01.763465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-ee362544-9483-4571-aa3d-a907617d202c req-31422a65-77ec-470b-82c6-46ea0178541f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263769 May 12 19:00:01.764074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 51/94] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:01.769670 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:01.771665 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:01.778980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:01.779582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:01.780368 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:01.780801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:02.056408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:02.068009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:02.069702 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:02.071817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6bf9525d-c01c-4c18-80fe-b0f2829ca9ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.537389 May 12 19:00:02.072611 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 44/95] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:01 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:02.089472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:02.092585 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:02.127371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:02.128282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:02.143357 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:02.145797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:02.695134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:02.704314 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-608cf121-71dc-47e1-b94b-b725bb379fb1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.938916 May 12 19:00:02.710049 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 52/96] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:01 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:02.714859 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:02.715861 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:02.729200 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:02.729863 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:02.730952 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:02.731319 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:03.205258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:03.216284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d32f282b-6a83-4e21-aecd-98239cbe3905 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 1.142168 May 12 19:00:03.217242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 45/97] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:02 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:03.230195 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:03.238384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:03.249399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:03.249991 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:03.251012 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:03.251643 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:03.401829 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:03.415366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-40f98bfd-50d4-4d64-b981-dabf8004a0ee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.703984 May 12 19:00:03.427733 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 53/98] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:02 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:03.427733 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:03.427733 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:03.441130 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:03.443739 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:03.444557 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:03.445006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:03.813278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:03.828638 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e6c2446b-2bf0-4d72-8bbc-8e38cb229d6e tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1314 microversion: 2.1 time: 0.609025 May 12 19:00:03.830144 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 46/99] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:03 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:03.836619 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:03.838356 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:03.853821 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:03.855311 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:03.855801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:03.856534 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:04.140045 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:04.157748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:04.159445 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:04.161325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b341df8c-7aeb-49fc-9853-749c47f7ce43 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.743939 May 12 19:00:04.175224 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 54/100] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:03 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:04.181367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-2d821c33-bfce-4482-bbb8-edadb2d121ee req-0469015e-0efb-4f86-b8f6-74321ffd002f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b6a7d2-7257-49f6-9b8d-69d6a3909dc1", "tag": "45a2c903-cdc6-44e2-9c9e-1c74da169ec7"}, {"name": "network-changed", "server_uuid": "f3fae6df-666d-4354-9089-87b51631cb48", "tag": "1abe14a4-11ef-449b-a24c-786cad5c7d21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:04.205718 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-2d821c33-bfce-4482-bbb8-edadb2d121ee req-0469015e-0efb-4f86-b8f6-74321ffd002f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:04.206603 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-2d821c33-bfce-4482-bbb8-edadb2d121ee req-0469015e-0efb-4f86-b8f6-74321ffd002f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:04.222192 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-2d821c33-bfce-4482-bbb8-edadb2d121ee req-0469015e-0efb-4f86-b8f6-74321ffd002f service nova] Creating event network-changed:45a2c903-cdc6-44e2-9c9e-1c74da169ec7 for instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 on hv-cinder-79575 May 12 19:00:04.223257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-2d821c33-bfce-4482-bbb8-edadb2d121ee req-0469015e-0efb-4f86-b8f6-74321ffd002f service nova] Creating event network-changed:1abe14a4-11ef-449b-a24c-786cad5c7d21 for instance f3fae6df-666d-4354-9089-87b51631cb48 on hv-cinder-79575 May 12 19:00:04.231232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-2d821c33-bfce-4482-bbb8-edadb2d121ee req-0469015e-0efb-4f86-b8f6-74321ffd002f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054067 May 12 19:00:04.232177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 55/101] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:04.239927 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:04.241325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:04.260706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:04.261185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:04.262108 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:04.262663 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:04.569430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:04.588584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4e4ffc3c-1dfb-4607-befb-d508d363a6ed tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.756592 May 12 19:00:04.589689 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 47/102] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:03 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:04.597510 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:04.598484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:04.599789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:04.606909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:04.607591 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:04.608976 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:04.609582 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:04.616383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4f54db06-1145-4d4e-9968-1121a753161a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.382164 May 12 19:00:04.617447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 56/103] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:04 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:04.822777 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:04.831157 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4c394575-8df2-4b5f-aa53-b83dc3fbc9c2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.240555 May 12 19:00:04.834057 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 48/104] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:04 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:04.855861 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:04.856638 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:04.864821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:04.865452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:04.866447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:04.866950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:05.038328 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:05.056201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-89111cb8-1cb6-40e3-be61-44e788767d92 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1502 microversion: 2.1 time: 0.203226 May 12 19:00:05.068257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 57/105] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:04 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:05.182519 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:05.183395 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:05.190148 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:05.190667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:05.192015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:05.192615 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:05.201785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-b7b4161c-1c13-43cc-a6e2-490e9c5745c0 req-832c86e2-d3d6-4379-9a54-e8a1a96498ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1351fe24-18b4-4cb5-b54f-33595df43567", "name": "network-vif-plugged", "status": "completed", "tag": "892d0c20-1c89-4582-aee5-a3cc582f961d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:05.219275 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b7b4161c-1c13-43cc-a6e2-490e9c5745c0 req-832c86e2-d3d6-4379-9a54-e8a1a96498ae service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:05.222498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b7b4161c-1c13-43cc-a6e2-490e9c5745c0 req-832c86e2-d3d6-4379-9a54-e8a1a96498ae service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:05.241486 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-b7b4161c-1c13-43cc-a6e2-490e9c5745c0 req-832c86e2-d3d6-4379-9a54-e8a1a96498ae service nova] Creating event network-vif-plugged:892d0c20-1c89-4582-aee5-a3cc582f961d for instance 1351fe24-18b4-4cb5-b54f-33595df43567 on hv-cinder-79575 May 12 19:00:05.251349 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-b7b4161c-1c13-43cc-a6e2-490e9c5745c0 req-832c86e2-d3d6-4379-9a54-e8a1a96498ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054584 May 12 19:00:05.252588 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 58/106] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:00:05.353853 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:05.362093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:05.364530 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:05.365669 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-33846d79-8b57-4777-ab4e-5369f2f916d7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.189568 May 12 19:00:05.366468 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 49/107] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:05 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:05.608599 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:05.609936 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:05.616501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:05.617383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:05.617833 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:05.618148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:05.635706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:05.637023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:05.648116 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:05.648948 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:05.650655 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:05.651258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:06.187859 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:06.192528 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:06.196452 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4ac7efca-c777-4180-836e-48b021d928c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.565176 May 12 19:00:06.197055 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 50/108] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:05 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:06.202433 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:06.210279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-113b604b-6a93-4189-92e5-c49b5183c945 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.605584 May 12 19:00:06.210627 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:06.211935 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 59/109] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:05 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:06.219810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:06.223433 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:06.225558 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:06.227607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:06.384513 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:06.385796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:06.395911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:06.399623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:06.400620 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:06.401235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:06.479569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:06.488622 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2004f203-e2d3-4b75-8722-db7f16ec266f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.290003 May 12 19:00:06.493197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 51/110] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:06 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:06.522627 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5e70a5aa-696e-49e8-b259-89328f386ca2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09177848-3424-47f0-8de5-e46c376fae1c"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:06.524095 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5e70a5aa-696e-49e8-b259-89328f386ca2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:06.532404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e70a5aa-696e-49e8-b259-89328f386ca2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:06.533148 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e70a5aa-696e-49e8-b259-89328f386ca2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:06.534294 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e70a5aa-696e-49e8-b259-89328f386ca2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:06.534841 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e70a5aa-696e-49e8-b259-89328f386ca2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:06.620828 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:06.630707 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:06.633360 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:06.635339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d7e4fba3-8fdd-407c-be00-5073e0ad2897 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.255311 May 12 19:00:06.637571 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 60/111] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:06 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:07.227689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:07.228552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:07.238075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.238604 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.239295 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.239725 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.397992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:07.407134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9a9c675f-c4ed-464a-ab9a-85e7c0f53778 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.196681 May 12 19:00:07.408038 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 61/112] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:07 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:07.413739 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:07.414352 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:07.420717 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.421243 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.422259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.422703 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.599174 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:07.607608 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a856cf2b-1cc0-4d66-b673-53a22818758d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.198219 May 12 19:00:07.608213 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 62/113] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:07 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:07.618045 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:07.618045 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:07.637371 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.644395 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.646062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.646714 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.838303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:07.847566 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-eed3e9c5-148d-4b30-88db-036200441342 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.237583 May 12 19:00:07.848131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 63/114] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:07 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:07.852807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:07.853592 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:07.859384 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.859836 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.860607 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:07.861048 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:07.995329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:08.002898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:08.005084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:08.006247 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-78f43339-46b1-4b45-9815-308c023a076f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.157032 May 12 19:00:08.006808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 64/115] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:07 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:08.424017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:08.424670 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:08.431337 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:08.432303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:08.438841 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:08.439654 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:08.442009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5e70a5aa-696e-49e8-b259-89328f386ca2 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "POST /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.924981 May 12 19:00:08.450480 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 52/116] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:00:06 2022] POST /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c/os-volume_attachments => generated 194 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:00:08.626914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:08.627705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:08.637452 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:08.638359 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:08.639475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:08.639919 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:08.940206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:08.957315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2f4ff91b-4e67-4400-8714-a16dd0b04880 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.536802 May 12 19:00:08.958700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 65/117] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:08 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:08.966418 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:08.967063 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:08.974135 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:08.974867 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:08.976347 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:08.976850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:08.980328 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:08.995823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-82468902-6bee-48e2-bfba-89d8fda884fc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.375036 May 12 19:00:08.997577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 53/118] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:08 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:09.024382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:09.024993 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:09.035515 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:09.037092 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:09.039247 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:09.041748 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:09.186984 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:09.195235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-87d6935f-add7-4bf1-af8d-fbfefc511149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.235276 May 12 19:00:09.207790 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 66/119] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:08 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:09.335726 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:09.343967 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:09.345458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:09.346603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ce318749-34f2-48a2-9177-1cf4a411f856 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.326400 May 12 19:00:09.347162 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 54/120] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:09 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:00:09.391107 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-2de3cd68-0aaa-4ed0-a2b0-f63001f82d1c req-4915af36-6d88-477a-8b73-089c26e07924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bcf7c1-c1cd-4149-af79-39ad90968742", "name": "network-vif-plugged", "status": "completed", "tag": "1b6193bd-0c92-47cd-8e4c-4291685e61ee"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:09.406708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-2de3cd68-0aaa-4ed0-a2b0-f63001f82d1c req-4915af36-6d88-477a-8b73-089c26e07924 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:09.408677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-2de3cd68-0aaa-4ed0-a2b0-f63001f82d1c req-4915af36-6d88-477a-8b73-089c26e07924 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:09.428420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-2de3cd68-0aaa-4ed0-a2b0-f63001f82d1c req-4915af36-6d88-477a-8b73-089c26e07924 service nova] Creating event network-vif-plugged:1b6193bd-0c92-47cd-8e4c-4291685e61ee for instance 64bcf7c1-c1cd-4149-af79-39ad90968742 on hv-cinder-79575 May 12 19:00:09.438706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-2de3cd68-0aaa-4ed0-a2b0-f63001f82d1c req-4915af36-6d88-477a-8b73-089c26e07924 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050781 May 12 19:00:09.440284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 67/121] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:09.981218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:09.982112 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:09.994715 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:09.995133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:09.995960 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:10.003127 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:10.014450 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:10.015631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:10.028455 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:10.031055 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:10.036222 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:10.040339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:10.481397 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:10.489947 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-86f5db67-be64-4983-8cd6-5ef71bdd5921 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.519181 May 12 19:00:10.509011 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 55/122] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:09 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:10.515224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:10.515838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:10.519069 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:10.538896 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:10.542670 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:10.543933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0e2f4787-6e27-43d2-ae6a-b62d17c7b091 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.532450 May 12 19:00:10.544762 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 68/123] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:10 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:10.554818 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:10.557919 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:10.558274 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:10.559041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:10.570989 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:10.571444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:10.572214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:10.578149 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:10.861040 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:10.867024 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:10.875184 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:10.875378 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4262ac53-f924-4c9a-addc-522db19c2869 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.365214 May 12 19:00:10.877099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 56/124] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:10 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:10.878212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:10.879893 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d2e623e4-6d56-4e0e-9b43-b342059a77a1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.332307 May 12 19:00:10.881561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 69/125] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:10 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:11.515742 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:11.516602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:11.526427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:11.528271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:11.530213 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:11.531003 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:11.562631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:11.564073 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:11.573155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:11.575195 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:11.577846 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:11.578593 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:11.897471 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:11.924489 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d8379a29-6e9f-470d-88bb-6d05a8ed559a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.411982 May 12 19:00:11.927609 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 57/126] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:11 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:11.944348 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:11.947469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:11.957944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:11.960966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:11.962094 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:11.965820 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-831a9291-c5d8-4ddc-b187-c704cf5c991c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1367 microversion: 2.1 time: 0.408163 May 12 19:00:11.966409 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 70/127] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:11 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1367 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:11.970354 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:11.971109 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:11.985767 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:11.986411 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:12.006874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:12.007216 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:12.008716 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:12.009315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:12.293939 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:12.303086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:12.311223 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3fc24408-4eba-4bd6-ada7-4dbf30aae71e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.380072 May 12 19:00:12.311849 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 58/128] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:11 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:12.317156 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:12.318726 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:12.319853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-01e20ea6-6c8e-4f92-814f-998e8904f3eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.345403 May 12 19:00:12.320392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 71/129] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:11 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:12.388568 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-620eec90-4110-4f08-a550-b34fc5d6ee90 req-0652680e-e887-4e5c-ad2c-7e8e38e4d7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fae6df-666d-4354-9089-87b51631cb48", "name": "network-vif-plugged", "status": "completed", "tag": "1abe14a4-11ef-449b-a24c-786cad5c7d21"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:12.400529 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-620eec90-4110-4f08-a550-b34fc5d6ee90 req-0652680e-e887-4e5c-ad2c-7e8e38e4d7a9 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:12.401552 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-620eec90-4110-4f08-a550-b34fc5d6ee90 req-0652680e-e887-4e5c-ad2c-7e8e38e4d7a9 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:12.422797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-620eec90-4110-4f08-a550-b34fc5d6ee90 req-0652680e-e887-4e5c-ad2c-7e8e38e4d7a9 service nova] Creating event network-vif-plugged:1abe14a4-11ef-449b-a24c-786cad5c7d21 for instance f3fae6df-666d-4354-9089-87b51631cb48 on hv-cinder-79575 May 12 19:00:12.433463 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-620eec90-4110-4f08-a550-b34fc5d6ee90 req-0652680e-e887-4e5c-ad2c-7e8e38e4d7a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050437 May 12 19:00:12.434119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 59/130] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:12.944422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:12.945740 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:12.952693 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:12.959153 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:12.960601 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:12.961215 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:12.983739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:12.985068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:12.996880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:12.997299 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:12.998279 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:12.998857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:13.277372 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:13.292283 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:13.295771 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d3b84a20-4507-4ec6-b667-7b94eb82434b tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.348251 May 12 19:00:13.298759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 72/131] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:12 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:13.300907 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6fb5838e-2c63-4873-97e1-176c3a5ce767 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1556 microversion: 2.1 time: 0.321495 May 12 19:00:13.312201 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 60/132] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:12 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1556 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:13.319634 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ad05ebb2-c6bc-4781-bb77-75ba07f27f09 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:13.320362 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ad05ebb2-c6bc-4781-bb77-75ba07f27f09 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:13.331006 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:13.337787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:13.346951 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad05ebb2-c6bc-4781-bb77-75ba07f27f09 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:13.349943 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad05ebb2-c6bc-4781-bb77-75ba07f27f09 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:13.351118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad05ebb2-c6bc-4781-bb77-75ba07f27f09 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:13.352690 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad05ebb2-c6bc-4781-bb77-75ba07f27f09 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:13.353615 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:13.355861 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:13.359515 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:13.361274 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:13.545940 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ad05ebb2-c6bc-4781-bb77-75ba07f27f09 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230627 May 12 19:00:13.547084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 73/133] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:00:13 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:13.563788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:13.565410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:13.579679 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:13.582251 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:13.586131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:13.586754 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:13.589145 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:13.597403 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1b987e3e-9316-48fd-a346-a42de5ff7bfa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.270156 May 12 19:00:13.607241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 61/134] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:13 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:13.758528 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:13.770602 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:13.772836 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:13.775973 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0d098b86-a379-4186-86de-32c0c5e207d8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1407 microversion: 2.20 time: 0.227518 May 12 19:00:13.776577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 74/135] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:13 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:14.329050 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:14.329843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:14.337659 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:14.338602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:14.339634 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:14.340276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:14.464311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-fa4986b1-0529-4f25-9f1b-8bbf8ac72575 req-d90128f1-3258-4266-8d5b-ea2795866230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b6a7d2-7257-49f6-9b8d-69d6a3909dc1", "name": "network-vif-plugged", "status": "completed", "tag": "45a2c903-cdc6-44e2-9c9e-1c74da169ec7"}, {"server_uuid": "398fab6a-ea82-46a2-907a-5c98b273d143", "name": "network-vif-plugged", "status": "completed", "tag": "48557972-00a2-459a-88df-83a565897bd6"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:14.490857 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-fa4986b1-0529-4f25-9f1b-8bbf8ac72575 req-d90128f1-3258-4266-8d5b-ea2795866230 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:14.491772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-fa4986b1-0529-4f25-9f1b-8bbf8ac72575 req-d90128f1-3258-4266-8d5b-ea2795866230 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:14.525159 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-fa4986b1-0529-4f25-9f1b-8bbf8ac72575 req-d90128f1-3258-4266-8d5b-ea2795866230 service nova] Creating event network-vif-plugged:45a2c903-cdc6-44e2-9c9e-1c74da169ec7 for instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 on hv-cinder-79575 May 12 19:00:14.526018 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-fa4986b1-0529-4f25-9f1b-8bbf8ac72575 req-d90128f1-3258-4266-8d5b-ea2795866230 service nova] Creating event network-vif-plugged:48557972-00a2-459a-88df-83a565897bd6 for instance 398fab6a-ea82-46a2-907a-5c98b273d143 on hv-cinder-79575 May 12 19:00:14.544553 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-fa4986b1-0529-4f25-9f1b-8bbf8ac72575 req-d90128f1-3258-4266-8d5b-ea2795866230 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084040 May 12 19:00:14.547788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 75/136] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:00:14.617510 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:14.618707 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:14.633275 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:14.636503 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:14.638054 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:14.638748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:14.808389 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:14.816737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7a01a87e-d07b-417b-a95b-d919fcf9ca0c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.492110 May 12 19:00:14.821114 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 62/137] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:14 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:14.834708 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:14.835725 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:14.848717 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:14.851148 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:14.852340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:14.854398 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:14.916744 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:14.926397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-eb284788-3e05-4553-bb49-6d79549e8149 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.314941 May 12 19:00:14.927339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 76/138] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:14 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:15.099576 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:15.108613 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:15.113360 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:15.117053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dd215c69-0864-42a9-9aa1-05ed73430c76 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1600 microversion: 2.20 time: 0.294498 May 12 19:00:15.119218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 63/139] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:00:14 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1600 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:00:15.142125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7381fc18-3a44-4d66-bde5-f14dde044c38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:15.142733 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7381fc18-3a44-4d66-bde5-f14dde044c38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:15.152034 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7381fc18-3a44-4d66-bde5-f14dde044c38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:15.152648 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7381fc18-3a44-4d66-bde5-f14dde044c38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:15.153664 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7381fc18-3a44-4d66-bde5-f14dde044c38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:15.154486 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7381fc18-3a44-4d66-bde5-f14dde044c38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:15.258942 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7381fc18-3a44-4d66-bde5-f14dde044c38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122018 May 12 19:00:15.266728 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 77/140] 10.222.0.48 () {60 vars in 1315 bytes} [Thu May 12 19:00:15 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:00:15.573853 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-050b4678-e859-479d-9f24-d05c6e6b3fba req-7e5360a1-c493-45e7-a30a-f3acb8258603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64bcf7c1-c1cd-4149-af79-39ad90968742", "tag": "1b6193bd-0c92-47cd-8e4c-4291685e61ee"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:15.600680 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-050b4678-e859-479d-9f24-d05c6e6b3fba req-7e5360a1-c493-45e7-a30a-f3acb8258603 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:15.600971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-050b4678-e859-479d-9f24-d05c6e6b3fba req-7e5360a1-c493-45e7-a30a-f3acb8258603 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:15.620930 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-050b4678-e859-479d-9f24-d05c6e6b3fba req-7e5360a1-c493-45e7-a30a-f3acb8258603 service nova] Creating event network-changed:1b6193bd-0c92-47cd-8e4c-4291685e61ee for instance 64bcf7c1-c1cd-4149-af79-39ad90968742 on hv-cinder-79575 May 12 19:00:15.634101 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-050b4678-e859-479d-9f24-d05c6e6b3fba req-7e5360a1-c493-45e7-a30a-f3acb8258603 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064066 May 12 19:00:15.638437 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 64/141] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:15.838797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:15.839389 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:15.846079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:15.846526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:15.847294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:15.847727 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:15.951231 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:15.951927 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:15.958874 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:15.959318 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:15.960281 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:15.960725 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:16.217415 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:16.227162 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-cda68fd9-e2bb-4344-b4c2-ca012cf9e007 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.392142 May 12 19:00:16.229765 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 78/142] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:15 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:16.284205 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:16.291807 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-07005b18-0f31-4680-8d1b-17584e216e56 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.344709 May 12 19:00:16.292377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 65/143] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:15 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:16.721564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-a4e11996-c36f-4ca2-8b29-5a48810a091e req-9cc135ef-92c3-4c0c-ab5f-4e9f0659ab8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fae6df-666d-4354-9089-87b51631cb48", "tag": "1abe14a4-11ef-449b-a24c-786cad5c7d21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:16.730325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-a4e11996-c36f-4ca2-8b29-5a48810a091e req-9cc135ef-92c3-4c0c-ab5f-4e9f0659ab8f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:16.730918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-a4e11996-c36f-4ca2-8b29-5a48810a091e req-9cc135ef-92c3-4c0c-ab5f-4e9f0659ab8f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:16.743442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-a4e11996-c36f-4ca2-8b29-5a48810a091e req-9cc135ef-92c3-4c0c-ab5f-4e9f0659ab8f service nova] Creating event network-changed:1abe14a4-11ef-449b-a24c-786cad5c7d21 for instance f3fae6df-666d-4354-9089-87b51631cb48 on hv-cinder-79575 May 12 19:00:16.749358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-a4e11996-c36f-4ca2-8b29-5a48810a091e req-9cc135ef-92c3-4c0c-ab5f-4e9f0659ab8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031267 May 12 19:00:16.750140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 79/144] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:00:17.243884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:17.244498 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:17.250884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:17.251327 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:17.252271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:17.252707 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:17.309913 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:17.310807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:17.317605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:17.318129 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:17.318994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:17.319507 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:17.418658 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:17.426218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b3bc17b8-c260-44eb-b778-e68d605f52c9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.186127 May 12 19:00:17.426794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 66/145] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:17 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:17.478259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:17.485625 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5f6ba7d5-4677-4482-8f75-c5b08fbe17cb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.179891 May 12 19:00:17.486232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 80/146] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:17 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:18.443004 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:18.443610 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:18.450161 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:18.450523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:18.451342 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:18.451774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:18.502432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:18.503031 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:18.509003 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:18.509448 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:18.510258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:18.510695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:18.736334 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:18.740614 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:18.744024 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-03f11289-022e-4ec7-90e5-b06b6a0591a7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.305058 May 12 19:00:18.744602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 67/147] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:18 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:18.748093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ce0fd7cf-bbd6-4033-bcb2-bb65e56c0ef7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.249521 May 12 19:00:18.748643 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 81/148] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:18 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:19.760186 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:19.760913 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:19.764204 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:19.764899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:19.767303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:19.767768 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:19.768539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:19.768978 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:19.770711 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:19.771270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:19.772031 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:19.772460 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:20.091253 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:20.097995 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:20.104935 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-070e58ba-9726-4d4c-8bf5-58eef30c7ef2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.348485 May 12 19:00:20.105289 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f74f51ce-b364-46eb-9ced-d7412ada8a05 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1322 microversion: 2.1 time: 0.345101 May 12 19:00:20.105712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 68/149] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:19 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:20.105890 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 82/150] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:19 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:21.121637 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:21.123066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:21.123688 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:21.125970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:21.133290 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.133774 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.134564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.134692 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.135010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.135121 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.135957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.136625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.345647 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:21.349399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:21.357227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-76ed6055-cddc-4fab-802f-c993ebe6a5c5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1363 microversion: 2.1 time: 0.239250 May 12 19:00:21.357887 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 69/151] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:21 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:21.361047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-dbdaaac0-5f37-4ef0-b4a5-999a2373cc2c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1516 microversion: 2.1 time: 0.242212 May 12 19:00:21.368779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 83/152] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:21 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:21.379431 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:21.380465 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:21.386311 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.386758 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.387531 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.387959 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.411707 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lazy-loading 'flavor' on Instance uuid 398fab6a-ea82-46a2-907a-5c98b273d143 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:00:21.532692 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-615bfc6e-8f97-46d2-971f-6a6ff471bbe6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143/action" status: 200 len: 32 microversion: 2.1 time: 0.157204 May 12 19:00:21.533586 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 70/153] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:00:21 2022] POST /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:00:21.544041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:21.544769 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:21.551330 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.552082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.553019 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:21.553722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:21.695449 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:21.702756 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5be42d14-5d9d-4433-aed5-30ecec992f72 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.163335 May 12 19:00:21.703321 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 84/154] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:21 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:22.374955 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:22.375888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:22.382772 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:22.383216 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:22.383982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:22.384414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:22.517460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:22.525451 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d747a4f3-dd4b-4b8e-aff7-3576e99d2c97 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1549 microversion: 2.1 time: 0.155048 May 12 19:00:22.526045 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 71/155] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:22 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:22.542426 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c5388ce7-6180-4280-bdc4-b01c94925267 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:22.542880 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c5388ce7-6180-4280-bdc4-b01c94925267 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:22.548564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5388ce7-6180-4280-bdc4-b01c94925267 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:22.549004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5388ce7-6180-4280-bdc4-b01c94925267 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:22.549801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5388ce7-6180-4280-bdc4-b01c94925267 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:22.550238 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5388ce7-6180-4280-bdc4-b01c94925267 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:22.626530 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c5388ce7-6180-4280-bdc4-b01c94925267 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088189 May 12 19:00:22.627125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 85/156] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:00:22 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:22.720620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:22.721743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:22.745337 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:22.746048 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:22.748238 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:22.750000 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:22.951009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:22.958651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e4761d5b-a2e5-48b7-b324-c4ee3bf60895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.242163 May 12 19:00:22.968823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 72/157] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:22 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:23.620078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:23.620564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:23.627958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:23.631331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:23.633627 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:23.634411 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:23.687874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:00:23.856745 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-86a2d8e7-e968-49d5-a81f-88f9a4b1826c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 204 len: 0 microversion: 2.1 time: 0.240543 May 12 19:00:23.857829 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 86/158] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:00:23 2022] DELETE /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:00:23.867156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:23.868500 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:23.880374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:23.880833 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:23.881693 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:23.882170 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:23.980015 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:23.981082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:23.989572 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:23.990269 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:23.991228 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:23.991806 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:24.383204 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:24.398430 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:24.406182 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a4bb27ae-ec57-42af-89af-58192a76bcfe tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1554 microversion: 2.1 time: 0.543629 May 12 19:00:24.407001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 73/159] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:23 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1554 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:24.419382 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9b7f113c-2a28-42a1-8109-e863b2ee862a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.445008 May 12 19:00:24.420680 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 87/160] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:23 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:24.421796 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-52bf868f-6077-4b01-9cf1-fc10bda5026f req-056af9f5-ddbe-42fd-b4d0-87a5d6bee192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b6a7d2-7257-49f6-9b8d-69d6a3909dc1", "tag": "45a2c903-cdc6-44e2-9c9e-1c74da169ec7"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:24.430965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-52bf868f-6077-4b01-9cf1-fc10bda5026f req-056af9f5-ddbe-42fd-b4d0-87a5d6bee192 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:24.431406 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-52bf868f-6077-4b01-9cf1-fc10bda5026f req-056af9f5-ddbe-42fd-b4d0-87a5d6bee192 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:24.462177 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-52bf868f-6077-4b01-9cf1-fc10bda5026f req-056af9f5-ddbe-42fd-b4d0-87a5d6bee192 service nova] Creating event network-changed:45a2c903-cdc6-44e2-9c9e-1c74da169ec7 for instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 on hv-cinder-79575 May 12 19:00:24.474059 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-52bf868f-6077-4b01-9cf1-fc10bda5026f req-056af9f5-ddbe-42fd-b4d0-87a5d6bee192 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065177 May 12 19:00:24.475406 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 74/161] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:25.425093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:25.427006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:25.434999 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:25.436413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:25.437306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:25.438077 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:25.438621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:25.439263 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:25.451539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:25.453727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:25.454773 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:25.455065 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:25.993515 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:25.996491 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:26.002844 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-10e4921e-acd8-46b3-909a-3d6d17edfb3d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1554 microversion: 2.1 time: 0.581426 May 12 19:00:26.004248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 88/162] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:25 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1554 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:26.004659 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-75eae097-b791-4f42-b27c-7e635673b2a5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.571251 May 12 19:00:26.005233 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 75/163] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:25 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:27.022243 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:27.022957 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:27.028127 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:27.028749 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:27.029667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:27.030324 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:27.031347 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:27.031852 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:27.037549 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:27.037991 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:27.038815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:27.039449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:27.438763 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:27.441411 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:27.447410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5caeb6c9-e308-4343-9aca-046580f20a04 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1554 microversion: 2.1 time: 0.430813 May 12 19:00:27.454078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 89/164] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:27 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1554 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:27.454229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-53c5be22-fd78-469d-a353-dc802a7bd5a4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.426322 May 12 19:00:27.454229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 76/165] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:27 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:27.712869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-328bdcbc-3eb1-430e-8777-90e82ef815eb req-edfeec8c-978c-4565-a7e2-51badb2c8b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10655ce7-9ca0-49c7-b182-0d2447b6c93c", "name": "network-vif-deleted", "tag": "d1c66529-6b79-49ae-a06f-387cfa61a5ad"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:00:27.721023 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-328bdcbc-3eb1-430e-8777-90e82ef815eb req-edfeec8c-978c-4565-a7e2-51badb2c8b24 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:27.721661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-328bdcbc-3eb1-430e-8777-90e82ef815eb req-edfeec8c-978c-4565-a7e2-51badb2c8b24 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:27.742705 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-328bdcbc-3eb1-430e-8777-90e82ef815eb req-edfeec8c-978c-4565-a7e2-51badb2c8b24 service nova] Creating event network-vif-deleted:d1c66529-6b79-49ae-a06f-387cfa61a5ad for instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c on hv-cinder-79575 May 12 19:00:27.748224 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-328bdcbc-3eb1-430e-8777-90e82ef815eb req-edfeec8c-978c-4565-a7e2-51badb2c8b24 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038993 May 12 19:00:27.749004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 90/166] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:00:28.471756 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:28.473268 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:28.479245 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:28.480034 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:28.491074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:28.491526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:28.492307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:28.492749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:28.494762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:28.495211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:28.496062 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:28.496489 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:28.615629 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:28.624594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-04b8daa2-dc61-417f-88c1-bc44b768a42c tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1345 microversion: 2.1 time: 0.161921 May 12 19:00:28.626109 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 77/167] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:28 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:28.684274 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:28.694151 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-64e592d6-50a8-405c-a7fb-2c3e76e13910 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.230860 May 12 19:00:28.694724 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 91/168] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:28 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:29.641747 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:29.642354 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:29.649104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:29.649574 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:29.650341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:29.650771 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:29.711857 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:29.712510 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:29.718996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:29.719443 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:29.720225 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:29.720662 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:29.853836 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:29.861679 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b88edaf3-b1fa-482d-922c-e783f413a796 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1345 microversion: 2.1 time: 0.223693 May 12 19:00:29.862446 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 78/169] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:29 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1345 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:29.874821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:29.882487 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b03e6148-5ecb-446b-a3b5-f85b76de8cd7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.174649 May 12 19:00:29.883040 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 92/170] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:29 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:30.878869 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:30.879408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:30.885724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:30.886175 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:30.886943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:30.887379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:30.898370 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:30.898981 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:30.904937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:30.905384 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:30.906172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:30.906621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:30.949878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:30.957846 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-906a1c8b-f730-4688-b116-a58cd915382a tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1345 microversion: 2.1 time: 0.082902 May 12 19:00:30.958430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 79/171] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:30 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:31.042645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:31.049912 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5b4c544f-721a-4581-95f9-e34b56dc396a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.155300 May 12 19:00:31.050478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 93/172] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:30 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:31.974814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:31.975475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:31.982530 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:31.983374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:31.984148 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:31.984594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:32.045263 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfc6f930dea4e83a4fc58c9b02276f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61be60da66374c5b9c064eefb5b54dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:32.053134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-df0fdcc4-ef8e-463f-9c7a-26ecdf5712e9 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 200 len: 1345 microversion: 2.1 time: 0.082864 May 12 19:00:32.053720 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 80/173] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:31 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:32.066651 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:32.067356 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:32.073329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:32.073904 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:32.074737 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:32.075244 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:32.211379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:32.218774 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d6d3214d-8baa-4506-8fcb-59ff6a10e553 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.155965 May 12 19:00:32.219346 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 94/174] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:32 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:33.070168 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:33.070774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:33.077003 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:33.077382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:33.078178 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:33.078613 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:33.091957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] HTTP exception thrown: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Request method failure captured: May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c HTTP/1.1 May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkImBXnysHgiJ-gT-_GEFAQ-EuarlmoI_COZk7AVYJvmWtsyytdsq1xpxYQGHzzEos-kfAYEEM2Fw5n9kwylbnH37rXO_FX5T0nDg3HDZNsjScxF-0qoi1uYdBSi_w8-sllgRtfZ137w8Kb0zingqgtVxiUyMQkK5AMY6ActFnHL-U May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:00:33.096475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_61be60da66374c5b9c064eefb5b54dfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-DeleteServersTestJSON-676110705 May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 6dfc6f930dea4e83a4fc58c9b02276f6 May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.097965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '10655ce7-9ca0-49c7-b182-0d2447b6c93c'} May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:00:33.098812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.100108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:33.101295 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Returning 404 to user: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:00:33.101295 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1a32ccb1-3e8f-4e4e-aba7-ad9cbe56123d tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 404 len: 111 microversion: 2.1 time: 0.032151 May 12 19:00:33.101295 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 81/175] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:33 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:00:33.202803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:33.203731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:33.210344 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:33.210798 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:33.211565 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:33.212002 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:33.224835 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] HTTP exception thrown: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Request method failure captured: May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c/os-volume_attachments HTTP/1.1 May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkImBXnysHgiJ-gT-_GEFAQ-EuarlmoI_COZk7AVYJvmWtsyytdsq1xpxYQGHzzEos-kfAYEEM2Fw5n9kwylbnH37rXO_FX5T0nDg3HDZNsjScxF-0qoi1uYdBSi_w8-sllgRtfZ137w8Kb0zingqgtVxiUyMQkK5AMY6ActFnHL-U May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:00:33.228856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_61be60da66374c5b9c064eefb5b54dfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-DeleteServersTestJSON-676110705 May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 6dfc6f930dea4e83a4fc58c9b02276f6 May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'server_id': '10655ce7-9ca0-49c7-b182-0d2447b6c93c'} May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:00:33.231221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:33.232438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:33.233818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Returning 404 to user: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:00:33.233818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7528bd79-6bd5-44a6-947c-b46a4463b676 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031463 May 12 19:00:33.233818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 95/176] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:00:33 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:00:33.238185 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:33.238809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:33.245087 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:33.245568 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:33.246355 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:33.246790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:33.385686 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:33.400859 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f3bb1030-5c72-45a3-b845-e730d30e6922 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.167237 May 12 19:00:33.401688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 82/177] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:33 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:34.420543 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:34.421160 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:34.427215 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:34.427512 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:34.428272 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:34.428711 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:34.555611 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:34.562829 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6fadef57-74a7-4b07-b80c-d9c45e3740ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.146376 May 12 19:00:34.563380 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 96/178] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:34 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:35.579960 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:35.580630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:35.587452 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:35.587901 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:35.588667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:35.589105 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:35.718001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:35.725305 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e606447d-8267-459c-94bb-8379fd5efad4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.149151 May 12 19:00:35.725890 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 83/179] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:35 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:36.519194 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:36.519884 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:36.525919 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:36.526370 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:36.527162 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:36.527596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:36.541835 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] HTTP exception thrown: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Request method failure captured: May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c HTTP/1.1 May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkImBXnysHgiJ-gT-_GEFAQ-EuarlmoI_COZk7AVYJvmWtsyytdsq1xpxYQGHzzEos-kfAYEEM2Fw5n9kwylbnH37rXO_FX5T0nDg3HDZNsjScxF-0qoi1uYdBSi_w8-sllgRtfZ137w8Kb0zingqgtVxiUyMQkK5AMY6ActFnHL-U May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:00:36.543987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_61be60da66374c5b9c064eefb5b54dfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-DeleteServersTestJSON-676110705 May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 6dfc6f930dea4e83a4fc58c9b02276f6 May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.545343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '10655ce7-9ca0-49c7-b182-0d2447b6c93c'} May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:00:36.546227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.547325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:00:36.548339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Returning 404 to user: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:00:36.548339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-28154931-cb80-4585-9b4e-227ad5d446ed tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "DELETE /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 404 len: 111 microversion: 2.1 time: 0.031341 May 12 19:00:36.548339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 97/180] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:00:36 2022] DELETE /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:00:36.553747 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:36.554355 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] [instance: 10655ce7-9ca0-49c7-b182-0d2447b6c93c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:36.560141 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:36.560579 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:36.561331 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:36.561796 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:36.575818 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] HTTP exception thrown: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Request method failure captured: May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c HTTP/1.1 May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkImBXnysHgiJ-gT-_GEFAQ-EuarlmoI_COZk7AVYJvmWtsyytdsq1xpxYQGHzzEos-kfAYEEM2Fw5n9kwylbnH37rXO_FX5T0nDg3HDZNsjScxF-0qoi1uYdBSi_w8-sllgRtfZ137w8Kb0zingqgtVxiUyMQkK5AMY6ActFnHL-U May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:00:36.578075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_61be60da66374c5b9c064eefb5b54dfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/61be60da66374c5b9c064eefb5b54dfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-DeleteServersTestJSON-676110705 May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 61be60da66374c5b9c064eefb5b54dfe May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-DeleteServersTestJSON-676110705 May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 6dfc6f930dea4e83a4fc58c9b02276f6 May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-DeleteServersTestJSON-676110705-project May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.579319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '10655ce7-9ca0-49c7-b182-0d2447b6c93c'} May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:00:36.580010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. May 12 19:00:36.582269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:00:36.583426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] Returning 404 to user: Instance 10655ce7-9ca0-49c7-b182-0d2447b6c93c could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:00:36.583426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-aebd53aa-1680-4348-8c24-cb8fcd3ffb60 tempest-DeleteServersTestJSON-676110705 tempest-DeleteServersTestJSON-676110705-project] 10.222.0.48 "GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c" status: 404 len: 111 microversion: 2.1 time: 0.029487 May 12 19:00:36.583426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 84/181] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:36 2022] GET /compute/v2.1/servers/10655ce7-9ca0-49c7-b182-0d2447b6c93c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:00:36.742142 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:36.743134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:36.749465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:36.749933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:36.750730 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:36.751155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:36.923394 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:36.930848 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4b880c30-978d-42d7-a689-2b899213fd6d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.192617 May 12 19:00:36.931409 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 98/182] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:36 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:37.947468 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:37.948083 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:37.954204 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:37.954649 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:37.955414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:37.955849 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:38.089931 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:38.097848 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d8db09b4-de53-484d-ba98-02f2234587b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.154083 May 12 19:00:38.098411 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 85/183] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:37 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:39.115248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:39.115871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:39.129689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:39.129870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:39.130880 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:39.131608 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:39.287501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:39.297165 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-25568b41-40a7-4368-b1d6-dfb7038f4242 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.186119 May 12 19:00:39.297859 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 99/184] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:39 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:40.315577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:40.316539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:40.325440 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:40.325920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:40.326698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:40.327133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:40.500935 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:40.511145 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-52e16373-fb58-4467-9bcb-2f3870f3d061 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.199378 May 12 19:00:40.511719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 86/185] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:40 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:41.528289 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:41.529422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:41.536893 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:41.537338 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:41.538137 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:41.538568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:41.679341 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:41.686527 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e15a2639-97b4-4dba-9719-4a4eb2ce14ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.162155 May 12 19:00:41.687763 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 100/186] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:41 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:42.704728 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:42.705325 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:42.711760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:42.712218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:42.712982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:42.713417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:42.847225 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:42.853828 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3a01d4e2-c10d-4976-bafb-6e2211de8fef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.152786 May 12 19:00:42.854391 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 87/187] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:42 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:43.870606 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:43.871189 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:43.876954 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:43.877404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:43.878212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:43.878650 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:44.002701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:44.010043 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9d3709a9-a058-4f12-9fa8-d88d3e804532 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.143302 May 12 19:00:44.010606 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 101/188] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:43 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:45.027002 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:45.027612 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:45.033882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:45.034332 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:45.035094 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:45.035530 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:45.162483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:45.170069 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-78135a4e-ddfc-467a-8980-97f92051a935 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.146865 May 12 19:00:45.170782 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 88/189] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:45 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:46.187906 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:46.188518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:46.195053 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:46.195504 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:46.196271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:46.197170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:46.321913 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:46.329153 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-64aad513-e2fc-46af-9e58-f0755eb9f4e9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.145034 May 12 19:00:46.329756 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 102/190] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:46 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:47.346181 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:47.346787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:47.353436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:47.353916 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:47.354675 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:47.355103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:47.481920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:47.489607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5496fe33-7a2b-40cd-ad33-0bfbab925262 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.147146 May 12 19:00:47.490896 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 89/191] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:47 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:48.507328 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:48.507840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:48.513664 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:48.514085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:48.514838 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:48.515267 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:48.643597 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:48.651911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-59a78de7-02cf-4d7b-a43d-6818cbecc59c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.148322 May 12 19:00:48.652488 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 103/192] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:48 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:49.669707 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:49.670281 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:49.676893 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:49.677856 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:49.678635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:49.679072 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:49.820171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:49.828645 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0ca95f14-074b-4dcc-bac2-7ccb005f7ded tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.162930 May 12 19:00:49.829333 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 90/193] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:49 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:50.845348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:50.845983 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:50.851719 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:50.852143 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:50.852897 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:50.853324 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:51.022166 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:51.031829 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5a46a88f-b624-4217-acdd-8e505c08a08d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.190138 May 12 19:00:51.034188 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 104/194] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:50 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:00:52.051856 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:52.052859 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:52.071660 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:52.072109 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:52.072908 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:52.073547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:52.237900 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:52.245915 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ea966ecf-b130-4d59-aff2-2639fcf07e35 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.198084 May 12 19:00:52.257555 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 91/195] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:52 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:53.264085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:53.264687 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:53.270695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:53.271640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:53.272408 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:53.272840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:53.404008 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:53.412731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3b306797-f147-449c-9f73-04452bc48a68 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.152367 May 12 19:00:53.417185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 105/196] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:53 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:54.434522 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:54.435192 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:54.441747 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:54.442205 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:54.443012 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:54.443496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:54.571147 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:54.579217 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f749c79e-6f44-4e31-84f5-294e9c97b808 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.148821 May 12 19:00:54.580217 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 92/197] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:54 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:55.596361 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:55.596966 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:55.602860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:55.603306 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:55.604063 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:55.604512 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:55.737232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:55.744979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4faef742-11a5-4e05-9447-15c21043b8fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.152641 May 12 19:00:55.745566 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 106/198] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:55 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:56.762143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:56.762998 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:56.773891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:56.773891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:56.773891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:56.773891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:56.909889 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:56.917503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5f9a716a-88ef-4a3d-b3e6-2d1934ab10cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.159220 May 12 19:00:56.918085 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 93/199] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:56 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:57.937686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:57.937686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:57.941207 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:57.941684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:57.942473 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:57.943507 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:58.083481 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:58.091621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7ecef468-a792-4c91-a7af-a7552dbdf32f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.160999 May 12 19:00:58.092811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 107/200] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:57 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:00:59.117510 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:00:59.118133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:00:59.125191 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:59.125693 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:59.126958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:00:59.127436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:00:59.261110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:00:59.268698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7a55b250-a606-46b9-8103-654addf488ef tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.155082 May 12 19:00:59.269282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 94/201] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:00:59 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:00.286010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:00.287209 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:00.298075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:00.298532 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:00.299308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:00.299751 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:00.498366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:00.506970 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-66954665-4c4f-41d3-8c17-b979aa76385f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.224602 May 12 19:01:00.516776 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 108/202] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:00 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:01.526368 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:01.527193 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:01.537473 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:01.538268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:01.539205 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:01.540117 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:01.721818 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:01.730175 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-caf0fe4c-5633-45c5-9236-0665e310b8bd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.208453 May 12 19:01:01.730745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 95/203] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:01 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:02.747016 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:02.747617 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:02.753391 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:02.753876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:02.755146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:02.755593 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:02.891704 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:02.900012 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9d5bdee3-d7e7-455b-a43e-d2cfbeb753ab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.156659 May 12 19:01:02.900589 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 109/204] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:02 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:03.919992 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:03.920628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:03.927351 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:03.927798 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:03.928581 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:03.929023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:04.061717 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:04.077302 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8f45f6eb-5895-4e15-8db2-81edfc5d244c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.159674 May 12 19:01:04.077302 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 96/205] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:03 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:05.089066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:05.089716 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:05.095700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:05.096181 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:05.096957 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:05.097395 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:05.239709 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:05.247082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d924974d-dc6b-419f-8dfd-81d8ced4f283 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.161804 May 12 19:01:05.247645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 110/206] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:05 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:06.263964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:06.264573 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:06.271379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:06.271828 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:06.272588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:06.273026 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:06.402760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:06.410052 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d8ad107d-af3f-4869-a691-95811e93fcf7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.149927 May 12 19:01:06.410608 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 97/207] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:06 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:07.428009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:07.428629 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:07.434456 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:07.434905 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:07.435695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:07.436128 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:07.561161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:07.568450 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6cece48c-a05b-45eb-b85a-f54d31ddf201 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.145005 May 12 19:01:07.569015 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 111/208] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:07 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:08.585136 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:08.585776 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:08.591705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:08.592155 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:08.593426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:08.593882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:08.722973 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:08.730830 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-632170d6-6195-4c37-bd5d-a2e7568fa731 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.149533 May 12 19:01:08.731391 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 98/209] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:08 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:09.748560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:09.749477 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:09.756255 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:09.756700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:09.757497 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:09.757961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:09.899722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:09.907495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-088d2bc1-42b1-4fa5-98c5-f7e381953365 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.163086 May 12 19:01:09.908069 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 112/210] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:09 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:10.602319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7ae0ef11-5cc4-414b-9fb3-e4f81f22d5d8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:10.602885 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7ae0ef11-5cc4-414b-9fb3-e4f81f22d5d8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:10.609235 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ae0ef11-5cc4-414b-9fb3-e4f81f22d5d8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:10.609719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ae0ef11-5cc4-414b-9fb3-e4f81f22d5d8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:10.610469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ae0ef11-5cc4-414b-9fb3-e4f81f22d5d8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:10.610900 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ae0ef11-5cc4-414b-9fb3-e4f81f22d5d8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:10.634432 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7ae0ef11-5cc4-414b-9fb3-e4f81f22d5d8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/ips" status: 200 len: 149 microversion: 2.1 time: 0.035871 May 12 19:01:10.635002 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 99/211] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:01:10 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:10.925607 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:10.927582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:10.933624 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:10.934136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:10.934972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:10.935404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:11.068222 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:11.075424 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-45af6002-db48-4182-99e6-d36ff8934755 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1522 microversion: 2.1 time: 0.153877 May 12 19:01:11.075990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 113/212] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:10 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:11.757981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5e9c29db-251f-4083-a01c-4ef45a120f70 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:11.758494 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5e9c29db-251f-4083-a01c-4ef45a120f70 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:11.764699 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e9c29db-251f-4083-a01c-4ef45a120f70 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:11.765145 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e9c29db-251f-4083-a01c-4ef45a120f70 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:11.765936 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e9c29db-251f-4083-a01c-4ef45a120f70 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:11.766370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5e9c29db-251f-4083-a01c-4ef45a120f70 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:11.789483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5e9c29db-251f-4083-a01c-4ef45a120f70 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/ips" status: 200 len: 153 microversion: 2.20 time: 0.035585 May 12 19:01:11.790069 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 100/213] 10.222.0.48 () {60 vars in 1288 bytes} [Thu May 12 19:01:11 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:01:11.979067 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a5c83746-1813-41dc-9909-2de8880cd9aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b01918f-2d79-41d9-bff6-29c8332d780c"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:11.980516 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a5c83746-1813-41dc-9909-2de8880cd9aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:11.986773 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a5c83746-1813-41dc-9909-2de8880cd9aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:11.987495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a5c83746-1813-41dc-9909-2de8880cd9aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:11.988444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a5c83746-1813-41dc-9909-2de8880cd9aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:11.988887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a5c83746-1813-41dc-9909-2de8880cd9aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:12.096328 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:12.097262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:12.104763 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:12.105208 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:12.106290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:12.107009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:12.241287 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:12.249957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-780b8918-fa41-4b65-859f-975445cf05b3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1502 microversion: 2.1 time: 0.161427 May 12 19:01:12.250733 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 101/214] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:12 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:12.271165 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:12.271797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:12.277812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:12.278259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:12.279014 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:12.279441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:12.407081 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:12.415005 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-41f730e2-fe11-44aa-ab39-bd20a9f1ffea tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1516 microversion: 2.1 time: 0.147796 May 12 19:01:12.415562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 102/215] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:12 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:14.979779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a5c83746-1813-41dc-9909-2de8880cd9aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.004651 May 12 19:01:14.980393 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 114/216] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:01:11 2022] POST /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments => generated 194 bytes in 3006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:20.042034 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:20.042985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:20.049345 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.049836 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.050607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.051243 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.073830 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lazy-loading 'flavor' on Instance uuid 1351fe24-18b4-4cb5-b54f-33595df43567 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:01:20.088674 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:20.096027 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:20.103996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.104568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.105702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.106143 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.131710 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lazy-loading 'flavor' on Instance uuid f3fae6df-666d-4354-9089-87b51631cb48 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:01:20.158438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2b80b44e-795a-4bee-9f93-98616abe344d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567/action" status: 200 len: 32 microversion: 2.1 time: 0.121069 May 12 19:01:20.158438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 103/217] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:01:20 2022] POST /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567/action => generated 32 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:01:20.167337 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:20.168023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:20.174317 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.175447 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.175574 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.176032 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.351727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:20.367758 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-54355d96-3823-4b76-b312-64b0e4a3d54a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.204661 May 12 19:01:20.378442 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 104/218] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:20 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:20.496180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7861098f-5a95-4f13-b7ff-1cc1d3ce665a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/action" status: 202 len: 0 microversion: 2.20 time: 0.412003 May 12 19:01:20.497189 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 115/219] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 12 19:01:20 2022] POST /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 19:01:20.512577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:20.513271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:20.525059 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.528170 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.529188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:20.529898 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:20.697295 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:20.704972 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:20.706516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:20.707698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3d0b5e19-ca1f-40b7-a79d-91f19ea17da5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.203686 May 12 19:01:20.708254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 105/220] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:20 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:21.387249 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:21.387953 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:21.394596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:21.395736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:21.396386 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:21.396826 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:21.670472 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:21.678289 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-eac8d11a-4eba-43f1-bb54-c852df577ecb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.295691 May 12 19:01:21.678859 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 116/221] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:21 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:21.725217 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:21.725854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:21.732226 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:21.732663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:21.733418 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:21.733869 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:21.864111 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:21.871867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:21.873298 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:21.874474 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d16e6c65-cb81-4bd9-9874-3baed980d9c5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.153071 May 12 19:01:21.875018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 106/222] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:21 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:22.696275 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:22.696889 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:22.702905 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:22.703349 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:22.704140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:22.704810 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:22.890771 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:22.892724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:22.893370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:22.898850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-baf067f5-6b97-4740-9266-9c2db45f123e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.207766 May 12 19:01:22.899420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 117/223] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:22 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:22.901347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:22.901942 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:22.902781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:22.903416 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:23.038626 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:23.046982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:23.048466 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:23.049643 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-25874f4e-3eaa-40c0-a87c-0cdf564bb70c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.160964 May 12 19:01:23.050687 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 107/224] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:22 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:23.916525 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:23.917757 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:23.923879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:23.924323 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:23.925081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:23.925514 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:24.068909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:24.070275 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:24.073325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:24.080957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:24.081202 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-fc0493a1-44d6-4c4e-be99-f8e967faf631 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.168412 May 12 19:01:24.081702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 118/225] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:23 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:24.085829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:24.086766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:24.087923 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:24.239214 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:24.246966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:24.248473 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:24.249663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5058746c-7524-49fa-9e60-b2e33914cace tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.185374 May 12 19:01:24.250239 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 108/226] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:24 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:25.098233 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:25.099676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:25.107411 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:25.107873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:25.108657 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:25.109260 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:25.268474 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:25.269104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:25.279796 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:25.280285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:25.281084 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:25.281557 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:25.391082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:25.400356 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8dc80b34-25ad-4b9e-9b50-46e7f9e125fc tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.306001 May 12 19:01:25.400952 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 119/227] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:25 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:25.469515 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:25.480367 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:25.482273 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:25.483825 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d08da1b0-6eaa-4fb8-8c9b-8536fa5542f7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.220077 May 12 19:01:25.484624 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 109/228] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:25 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:26.419272 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:26.419898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:26.427126 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:26.427696 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:26.428504 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:26.428974 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:26.502872 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:26.503486 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:26.509868 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:26.510319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:26.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:26.511541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:26.574743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:26.580586 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a02c4f44-d081-42e0-9159-66c3b1cd810b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.165272 May 12 19:01:26.581000 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 120/229] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:26 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:26.656843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:26.666244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:26.667865 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:26.669036 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ae08d043-ef5d-40b7-b95f-05266269c33d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.170238 May 12 19:01:26.669619 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 110/230] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:26 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:27.597669 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:27.598827 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:27.605054 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:27.605510 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:27.606320 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:27.606764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:27.688629 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:27.689238 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:27.696635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:27.697118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:27.698214 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:27.698709 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:27.749269 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:27.760177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0941a9b4-8e96-4a55-a84a-328ccbd50c27 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.163417 May 12 19:01:27.760177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 121/231] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:27 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:27.820664 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6bba19c9-0775-4a9b-844e-c2b39d9f5649 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: .version_select at 0x7f38c26b0d30>, body: {"keypair": {"name": "tempest-keypair-2115536028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvw8JoOuFaVxt3rL8kyPxvnRJnmkBxTyiBl7qHViUHEr1QpuY2m7ew6kVFh0jNcCA9p4F0Y+67zhStfuD7Rsz2xQFEYgMyAEjKyPK2tBBf6IlszP6xaZsYYfbAXDduRcQ=="}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:27.836183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-6bba19c9-0775-4a9b-844e-c2b39d9f5649 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:01:27.840118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-6bba19c9-0775-4a9b-844e-c2b39d9f5649 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:01:27.840856 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:27.849308 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:27.850756 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:27.851913 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8b44478a-a1f8-4229-90b9-ccab6b97cedc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.167271 May 12 19:01:27.852470 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 111/232] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:27 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:27.861498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6bba19c9-0775-4a9b-844e-c2b39d9f5649 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044614 May 12 19:01:27.862102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 122/233] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:01:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:01:28.774933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:28.775552 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:28.783018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:28.783506 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:28.784416 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:28.784936 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:28.871283 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:28.871933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:28.878179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:28.878443 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:28.879874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:28.880239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:28.932636 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:28.941208 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-79399cd2-8b9d-4960-9a94-975cb0229942 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.170604 May 12 19:01:28.942227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 112/234] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:28 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:29.015931 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:29.025239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:29.026412 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:29.027777 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-cdab724f-fba5-4670-901f-a6213c8d454c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.161110 May 12 19:01:29.028345 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 123/235] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:28 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:29.191330 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1442242059", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b"}], "security_groups": [{"name": "tempest-securitygroup--815574956"}], "key_name": "tempest-keypair-2115536028", "user_data": "}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:29.288578 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] validate_networks() for [('5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:01:29.667014 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:01:29.667430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:01:29.667902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:01:29.668306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:01:29.668713 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:01:29.677892 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:29.678344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:29.679141 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:29.679572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:29.696399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:01:29.700236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:01:29.711567 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:01:29.713837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:01:29.767281 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-871afb71-5a81-4aa3-a1fb-44e7fb4057c5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580190 May 12 19:01:29.773626 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 113/236] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:01:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:01:29.778853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3505094d-2e02-4c9d-8074-bb125071d2be tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:29.779472 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3505094d-2e02-4c9d-8074-bb125071d2be tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:29.806163 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2d7af9fd-0f2b-43a4-9f23-ab5324be12e1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:29.807223 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2d7af9fd-0f2b-43a4-9f23-ab5324be12e1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:29.821914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2d7af9fd-0f2b-43a4-9f23-ab5324be12e1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:29.822615 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2d7af9fd-0f2b-43a4-9f23-ab5324be12e1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:29.823556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2d7af9fd-0f2b-43a4-9f23-ab5324be12e1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:29.823992 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2d7af9fd-0f2b-43a4-9f23-ab5324be12e1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:29.852964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2d7af9fd-0f2b-43a4-9f23-ab5324be12e1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/ips" status: 200 len: 145 microversion: 2.1 time: 0.050532 May 12 19:01:29.857474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3505094d-2e02-4c9d-8074-bb125071d2be tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:29.859789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 114/237] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:01:29 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/ips => generated 145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:01:29.865610 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3505094d-2e02-4c9d-8074-bb125071d2be tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1242 microversion: 2.1 time: 0.090545 May 12 19:01:29.866177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 124/238] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:29 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:29.958213 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:29.958823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:29.966355 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:29.966982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:29.968163 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:29.968820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:30.048267 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:30.048886 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:30.059021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:30.059619 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:30.060669 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:30.061293 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:30.151759 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:30.161759 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f19f043f-fdc7-475f-a9b0-54f13f554ffb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.207900 May 12 19:01:30.162815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 115/239] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:29 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:30.252286 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:30.261517 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:30.265899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:30.267836 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2b790e67-9d35-4282-88ce-1e20c9e4f725 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.225520 May 12 19:01:30.268582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 125/240] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:30 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:30.881579 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:30.882185 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:30.888862 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:30.889487 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:30.890453 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:30.890883 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:30.956321 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:30.964185 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7febc6bc-75c1-48eb-a9c1-fb2d99ef119d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1294 microversion: 2.1 time: 0.086653 May 12 19:01:30.964739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 116/241] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:30 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:31.179860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:31.181500 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:31.187786 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:31.188443 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:31.204227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:31.204985 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:31.288438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:31.290688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:31.297248 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:31.298004 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:31.298924 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:31.299630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:31.545486 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:31.549864 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:31.556728 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0a5ba7df-a11f-4c1f-9cc3-4ada87d59522 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.380757 May 12 19:01:31.559651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:31.561456 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:31.562793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dc060ba1-e775-4c47-8bef-50d7ed576dd9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.279646 May 12 19:01:31.563458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 117/242] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:31 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:31.567695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 126/243] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:31 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:31.983090 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:31.984189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:31.991222 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:31.991681 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:31.992967 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:31.993465 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:32.099179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:32.108701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-61a81f45-9f6f-40cf-ace2-7932ca3869c4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1300 microversion: 2.1 time: 0.130159 May 12 19:01:32.109886 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 118/244] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:31 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:32.574732 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:32.582554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:32.582966 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:32.583709 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:32.593159 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:32.599960 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:32.601644 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:32.602236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:32.603738 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:32.604058 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:32.605350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:32.605458 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:32.896506 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:32.903749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ea8785c2-f464-450b-8984-69d95ae45a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.332792 May 12 19:01:32.904347 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 127/245] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:32 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:32.926406 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:32.935441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:32.937402 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:32.938853 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-be86266d-6bb9-4e31-a17e-748046bdeca5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.360679 May 12 19:01:32.952183 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 119/246] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:32 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:33.125139 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:33.126041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:33.132959 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.133484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.134346 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.135120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.281899 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-467331270", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:33.340411 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:33.346618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] validate_networks() for None {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:01:33.349358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e7024714-6c57-4a64-96c7-cfb6e1f85ff5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.228106 May 12 19:01:33.350994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 128/247] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:33 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:33.498920 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-50a95326-42ae-4d74-8481-21000d521676 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48407bbf-ba8f-433d-a277-12bc2cb4945f"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:33.501442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-50a95326-42ae-4d74-8481-21000d521676 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:33.509884 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-50a95326-42ae-4d74-8481-21000d521676 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.510939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-50a95326-42ae-4d74-8481-21000d521676 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.512131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-50a95326-42ae-4d74-8481-21000d521676 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.512619 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-50a95326-42ae-4d74-8481-21000d521676 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.839393 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:01:33.840014 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:01:33.840491 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:01:33.840915 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:01:33.841482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:01:33.857563 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.861347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.862286 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.862867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.879355 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-50a95326-42ae-4d74-8481-21000d521676 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384926 May 12 19:01:33.884668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 129/248] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:01:33 2022] POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:01:33.884826 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Getting quotas for project b1e982ed51d9445b8f05cb7ddee40660. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:01:33.899172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Getting quotas for user e32c7724a2f74e0fa25b0f596be7c81b and project b1e982ed51d9445b8f05cb7ddee40660. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:01:33.911254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:01:33.913167 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:01:33.922318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:33.923697 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:33.944667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.945380 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.946609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.947331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.965145 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-53d8890c-9840-4ab0-b40b-dd02e728b648 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688493 May 12 19:01:33.966121 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 120/249] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:01:33.980832 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:33.981796 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:33.992972 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.993492 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:33.994413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:33.994915 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:34.302402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:34.310701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-70a7899d-73fb-40c2-9068-e4fd071d334a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.393152 May 12 19:01:34.311581 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 130/250] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:33 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:34.317741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e301eb5d-8cbc-42ad-8dbd-6672f3be11de tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:34.318614 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e301eb5d-8cbc-42ad-8dbd-6672f3be11de tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:34.375494 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:34.384788 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:34.386643 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:34.388126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8438bdcc-4376-44f0-b045-d27d70488563 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.415408 May 12 19:01:34.389092 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 121/251] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:33 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:34.393649 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e301eb5d-8cbc-42ad-8dbd-6672f3be11de tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:34.395249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-367b4d06-fab0-4e6e-b1fc-57255538e464 req-a157b11f-ec6f-4328-bbc9-188543b1231e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b7344e-55ce-4f61-9c68-6473e53a5d9f", "tag": "9448ad28-f42c-4629-9127-6323c2e65835"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:34.402377 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e301eb5d-8cbc-42ad-8dbd-6672f3be11de tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1214 microversion: 2.1 time: 0.089493 May 12 19:01:34.403023 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 131/252] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:34 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:34.403675 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-367b4d06-fab0-4e6e-b1fc-57255538e464 req-a157b11f-ec6f-4328-bbc9-188543b1231e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:34.404166 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-367b4d06-fab0-4e6e-b1fc-57255538e464 req-a157b11f-ec6f-4328-bbc9-188543b1231e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:34.407565 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:34.408172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:34.415948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:34.416399 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:34.417182 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:34.417647 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:34.423011 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-367b4d06-fab0-4e6e-b1fc-57255538e464 req-a157b11f-ec6f-4328-bbc9-188543b1231e service nova] Creating event network-changed:9448ad28-f42c-4629-9127-6323c2e65835 for instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f on hv-cinder-79575 May 12 19:01:34.427880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-367b4d06-fab0-4e6e-b1fc-57255538e464 req-a157b11f-ec6f-4328-bbc9-188543b1231e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037279 May 12 19:01:34.428657 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 122/253] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:34.639040 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:34.649496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9bcdb78f-d537-4613-ac67-4ee5375d331f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.245393 May 12 19:01:34.650223 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 132/254] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:34 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:35.328730 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:35.329358 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:35.337255 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.337744 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.338525 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.338991 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.407419 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:35.407947 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:35.414478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.415113 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.415696 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.416136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.495276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:35.502573 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f770141b-3be6-4d7d-b9a9-1e4ce59da7a7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.178154 May 12 19:01:35.503156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 123/255] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:35 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:35.508100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:35.508705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:35.514495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.514941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.515706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.516141 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.566747 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:35.574992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:35.576622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:35.577929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-79df7124-12d7-443d-a8a3-37015b6da504 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.174573 May 12 19:01:35.578583 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 133/256] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:35 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:35.584833 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:35.592126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bae91a66-44b3-4d33-b33c-eb72dfc3891f tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1274 microversion: 2.1 time: 0.087544 May 12 19:01:35.592685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 124/257] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:35 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:35.666815 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:35.667366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:35.673246 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.673752 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.674525 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:35.674969 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:35.801766 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:35.808977 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e4dbec2f-7448-4bf3-840a-07cddde3b440 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.146214 May 12 19:01:35.809542 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 134/258] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:35 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:36.520823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:36.521346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:36.528656 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.529110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.530518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.530953 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.598295 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:36.599441 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:36.607478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.608181 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.609123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.609645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.835706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:36.843182 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a6a514e3-eb53-4884-af62-74683c54bbee tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.327028 May 12 19:01:36.843797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 125/259] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:36 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:36.849059 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:36.849759 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:36.855926 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.856378 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.857155 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.857624 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.972962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:36.976250 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:36.980585 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-07f1ef01-fb80-4843-9d5a-acf5373d0986 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1272 microversion: 2.1 time: 0.135662 May 12 19:01:36.989588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 126/260] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:36 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:36.989588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:36.989588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:36.992922 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.993257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:36.993662 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.994447 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:36.994887 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:36.995263 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:36.996813 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-19409f7f-8d8e-4ce8-804d-003fd35c4491 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1746 microversion: 2.20 time: 0.404431 May 12 19:01:36.997455 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 135/261] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:36 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1746 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:37.263630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:37.271516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-68ff1858-8738-4c58-94b8-77e2506b4d7b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.289322 May 12 19:01:37.272093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 127/262] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:36 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:37.861901 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:37.862526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:37.869625 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:37.870091 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:37.870888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:37.871329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:37.999285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:37.999882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:38.007077 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:38.007530 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:38.008322 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:38.008762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:38.277011 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:38.296890 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3ad8c115-7c56-4984-80ef-122f7050d7c9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.438722 May 12 19:01:38.298033 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 136/263] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:37 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:38.304580 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:38.306657 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:38.309599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:38.313926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:38.314804 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:38.316582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:38.317317 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:38.318750 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6eb9046a-171b-4ab3-ad7b-39e6c1d32a8d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.323261 May 12 19:01:38.319754 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 128/264] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:37 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:38.333197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:38.334331 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:38.340276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:38.340940 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:38.341943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:38.342524 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:38.613103 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:38.618706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:38.625088 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:38.626650 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:38.628403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-092bb316-f103-45d5-a5ea-79a74e046ec5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1746 microversion: 2.20 time: 0.328652 May 12 19:01:38.629609 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-15d0a0a0-f545-4c26-bcb7-f7e7112b51fd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.308310 May 12 19:01:38.629818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 137/265] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:38 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1746 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:38.640960 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 129/266] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:38 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:39.148315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-3248e3cd-c4f6-4cf6-aaae-99c2caf08551 req-a88fd328-b08c-4abf-8b0b-fc7530b23d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2967ef0-5b49-4af3-b3c2-5fb91e845621", "tag": "fc346978-3d3f-40f6-81be-74a96fef5c7d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:39.175138 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-3248e3cd-c4f6-4cf6-aaae-99c2caf08551 req-a88fd328-b08c-4abf-8b0b-fc7530b23d91 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.179641 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-3248e3cd-c4f6-4cf6-aaae-99c2caf08551 req-a88fd328-b08c-4abf-8b0b-fc7530b23d91 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.203947 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-3248e3cd-c4f6-4cf6-aaae-99c2caf08551 req-a88fd328-b08c-4abf-8b0b-fc7530b23d91 service nova] Creating event network-changed:fc346978-3d3f-40f6-81be-74a96fef5c7d for instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 on hv-cinder-79575 May 12 19:01:39.214592 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-3248e3cd-c4f6-4cf6-aaae-99c2caf08551 req-a88fd328-b08c-4abf-8b0b-fc7530b23d91 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071735 May 12 19:01:39.217864 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 138/267] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:39.320479 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:39.321621 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:39.330764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.330764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.337010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:39.337762 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:39.341681 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.342156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.348683 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.349150 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.349978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.350425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.695618 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:39.711846 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5165e6a5-9f15-46fd-9f6b-40baef801540 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.378973 May 12 19:01:39.712437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 139/268] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:39 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:39.718256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:39.719097 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:39.719771 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:39.731168 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f16e6305-8522-46e1-8975-45f1488bdf64 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.420764 May 12 19:01:39.733266 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 130/269] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:39 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:39.737663 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.738351 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:39.738950 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:39.739084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.740139 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.740735 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.745605 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.746236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:39.747179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:39.749164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:40.074909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:40.076300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:40.085416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:40.089099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d8b4b8f5-0b23-4847-8b50-fe96610ad147 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.352609 May 12 19:01:40.089753 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:40.091176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-25eb7272-d8a6-4ba9-b590-163c1c13d072 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.376684 May 12 19:01:40.091736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 140/270] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:39 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:40.096265 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-6b329491-b643-408c-a3ea-12127f031857 req-aa4a1055-61e4-4d4f-bad5-21d31305e8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fae6df-666d-4354-9089-87b51631cb48", "name": "network-vif-plugged", "status": "completed", "tag": "1abe14a4-11ef-449b-a24c-786cad5c7d21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:40.101928 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 131/271] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:39 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:40.105659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-6b329491-b643-408c-a3ea-12127f031857 req-aa4a1055-61e4-4d4f-bad5-21d31305e8db service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:40.106269 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-6b329491-b643-408c-a3ea-12127f031857 req-aa4a1055-61e4-4d4f-bad5-21d31305e8db service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:40.120820 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-6b329491-b643-408c-a3ea-12127f031857 req-aa4a1055-61e4-4d4f-bad5-21d31305e8db service nova] Creating event network-vif-plugged:1abe14a4-11ef-449b-a24c-786cad5c7d21 for instance f3fae6df-666d-4354-9089-87b51631cb48 on hv-cinder-79575 May 12 19:01:40.130968 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-6b329491-b643-408c-a3ea-12127f031857 req-aa4a1055-61e4-4d4f-bad5-21d31305e8db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036808 May 12 19:01:40.131761 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 141/272] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:40.728885 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:40.729660 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:40.736480 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:40.737037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:40.737882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:40.738534 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:40.760544 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:40.761403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:40.767888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:40.768590 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:40.770437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:40.771070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:41.069647 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:41.077745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-11675632-1c25-4ce6-bacb-fa0b52e2f2a1 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.352676 May 12 19:01:41.079019 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 132/273] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:40 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:41.097063 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:41.106932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-26629d12-fde9-4d29-b72f-2dc6421c5391 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.360074 May 12 19:01:41.107151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:41.107786 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:41.114078 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:41.114787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:41.115745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:41.116181 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:41.117113 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 142/274] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:40 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:41.121933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:41.122494 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:41.135861 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:41.136461 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:41.137495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:41.137702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:41.336140 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:41.348659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:41.356858 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-576b2ebd-4771-4fa7-9006-0728deb09519 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.253499 May 12 19:01:41.360066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:41.366409 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:41.367916 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d1097108-a492-4e3a-a61b-3f04d4697b85 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.249796 May 12 19:01:41.368475 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 143/275] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:41 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:41.369640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 133/276] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:41 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:42.098942 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:42.099707 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:42.125055 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:42.125867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:42.127545 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.129084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.130680 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.131674 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.136771 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.137229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.138176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.138620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.399482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:42.406593 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:42.407224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8a92d3c2-f9d6-4f04-bdc1-ef4dee82f31a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.286863 May 12 19:01:42.418177 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 134/277] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:42 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:42.423567 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-fc239449-19ae-49f2-bee9-bfc8590b588d req-8d244971-2ecd-4629-a524-20bdfb292642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b7344e-55ce-4f61-9c68-6473e53a5d9f", "name": "network-vif-plugged", "status": "completed", "tag": "9448ad28-f42c-4629-9127-6323c2e65835"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:42.432627 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-70e963c6-1216-46fc-aab0-c614b2a1687e tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.339256 May 12 19:01:42.432831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-fc239449-19ae-49f2-bee9-bfc8590b588d req-8d244971-2ecd-4629-a524-20bdfb292642 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.433279 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-fc239449-19ae-49f2-bee9-bfc8590b588d req-8d244971-2ecd-4629-a524-20bdfb292642 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.442366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 144/278] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:42 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:42.447875 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:42.450952 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:42.461346 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.462658 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.463087 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-fc239449-19ae-49f2-bee9-bfc8590b588d req-8d244971-2ecd-4629-a524-20bdfb292642 service nova] Creating event network-vif-plugged:9448ad28-f42c-4629-9127-6323c2e65835 for instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f on hv-cinder-79575 May 12 19:01:42.463809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.464402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.473262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-fc239449-19ae-49f2-bee9-bfc8590b588d req-8d244971-2ecd-4629-a524-20bdfb292642 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053755 May 12 19:01:42.474463 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 135/279] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:42.484604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:42.485558 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:42.493026 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.493729 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.494934 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.495549 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.669002 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:42.678772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f32b28ce-7b37-460b-9e50-dbd409639910 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.235008 May 12 19:01:42.679797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 145/280] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:42 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:42.689628 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2835f9d6-1493-4ec1-90ef-63e82c774ee3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:42.699630 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2835f9d6-1493-4ec1-90ef-63e82c774ee3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.700084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2835f9d6-1493-4ec1-90ef-63e82c774ee3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.728088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:42.742505 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:42.745215 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:42.746753 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ee0f4669-f2b1-4fb4-9462-d4ee296fd396 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.270966 May 12 19:01:42.747680 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 136/281] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:42 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:42.767486 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2835f9d6-1493-4ec1-90ef-63e82c774ee3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Going to try to stop instance {{(pid=117102) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 19:01:42.817308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2835f9d6-1493-4ec1-90ef-63e82c774ee3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action" status: 202 len: 0 microversion: 2.1 time: 0.135922 May 12 19:01:42.817961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 146/282] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:01:42 2022] POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:01:42.826920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:42.827542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:42.834841 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.835293 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.837306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:42.837728 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:42.983996 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:42.992737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3bea8996-3026-407b-8bf6-c1aeb591604c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.169511 May 12 19:01:42.993426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 137/283] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:42 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:43.429800 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:43.432275 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:43.441257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.442100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:43.442974 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.443432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:43.458691 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:43.459393 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:43.480991 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.481757 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:43.482599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.483074 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:43.699559 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:43.710744 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-972f3a74-397a-4501-9ac7-7386cc4bd43d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.289861 May 12 19:01:43.711561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 147/284] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:43 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:43.717978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:43.727884 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:43.740252 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.741564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:43.742318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.742772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:43.903902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:43.913048 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-53f204f8-f0a3-4cc1-8a3e-f76a0f759178 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.458394 May 12 19:01:43.930176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 138/285] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:43 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:43.934736 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:43.935282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:43.946564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.947022 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:43.947803 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:43.948245 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:44.248485 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:44.256839 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-df986024-0422-4fe7-9202-194875377e7f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.542424 May 12 19:01:44.266485 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 148/286] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:43 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:44.272043 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:44.272854 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:44.279522 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:44.279980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:44.280786 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:44.281283 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:44.334974 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:44.345976 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:44.348369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:44.351045 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dfadbb00-6e09-4875-b987-b9ded4009d79 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.420291 May 12 19:01:44.367217 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 139/287] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:43 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:44.452105 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:44.460206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-90cfca6f-71d9-4ecd-8bc3-6524dd946a8a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.192405 May 12 19:01:44.460782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 149/288] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:44 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:44.490521 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-a9b0d3e4-15d6-4650-b636-7f0f86a9fc08 req-794bb7dc-bdeb-4878-8b62-ea833a7d6650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2967ef0-5b49-4af3-b3c2-5fb91e845621", "name": "network-vif-plugged", "status": "completed", "tag": "fc346978-3d3f-40f6-81be-74a96fef5c7d"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:44.499055 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-a9b0d3e4-15d6-4650-b636-7f0f86a9fc08 req-794bb7dc-bdeb-4878-8b62-ea833a7d6650 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:44.499585 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-a9b0d3e4-15d6-4650-b636-7f0f86a9fc08 req-794bb7dc-bdeb-4878-8b62-ea833a7d6650 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:44.510935 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-a9b0d3e4-15d6-4650-b636-7f0f86a9fc08 req-794bb7dc-bdeb-4878-8b62-ea833a7d6650 service nova] Creating event network-vif-plugged:fc346978-3d3f-40f6-81be-74a96fef5c7d for instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 on hv-cinder-79575 May 12 19:01:44.515809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-a9b0d3e4-15d6-4650-b636-7f0f86a9fc08 req-794bb7dc-bdeb-4878-8b62-ea833a7d6650 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030459 May 12 19:01:44.516748 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 140/289] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:44.727899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:44.728865 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:44.736648 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:44.737224 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:44.738824 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:44.739531 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:44.912625 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:44.921057 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e239c323-bb86-40f1-8723-fc70cbe2f0d8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.196901 May 12 19:01:44.922374 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 150/290] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:44 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:44.941085 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:44.942314 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:44.948873 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:44.949395 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:44.950409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:44.950987 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.090383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:45.098686 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-998db70e-da07-4e17-a3a6-e015ef38cb06 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.163418 May 12 19:01:45.099275 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 141/291] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:44 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:45.273640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:45.274511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:45.280548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.281002 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.281863 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.282251 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.373710 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:45.374289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:45.381167 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.381647 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.382432 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.382876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.438450 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:45.447779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8ac735a0-e898-4b1f-a1d9-a9faedc33989 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1367 microversion: 2.1 time: 0.177994 May 12 19:01:45.458524 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 151/292] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:45 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:45.478782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:45.479714 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:45.487833 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.488921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.489785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.490220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.579712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:45.588868 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:45.591998 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:45.593684 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e2314915-efc8-4bb5-9f07-8c2e79930f2a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.224153 May 12 19:01:45.604981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 142/293] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:45 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:45.667587 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:45.678756 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-475ec108-ae63-46c6-bb0d-56a10c140f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.204097 May 12 19:01:45.679356 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 152/294] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:45 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:45.941767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:45.942581 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:45.949387 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.950020 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:45.950894 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:45.951344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.122564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:46.123484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:46.132024 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.132694 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.133686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.133806 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:46.134411 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.141342 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-26f3d0a6-1c05-4332-8027-3dac7b9b9a07 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.204725 May 12 19:01:46.142938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 143/295] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:45 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:46.294258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:46.303118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a024b100-d65a-4855-8b69-5c9360dff655 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.191463 May 12 19:01:46.312355 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 153/296] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:46 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:46.465803 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:46.466535 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:46.472716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.473183 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.473985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.474416 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.626895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:46.629172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:46.630295 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:46.637097 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-63d5c375-be35-46b1-beeb-74c4b8cf2c1e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1556 microversion: 2.1 time: 0.175112 May 12 19:01:46.638852 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 144/297] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:46 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:46.639476 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.640314 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.641720 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.642346 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.660163 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f755b93f-3043-4ec9-8046-75d928fba05f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:46.660761 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f755b93f-3043-4ec9-8046-75d928fba05f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:46.667252 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f755b93f-3043-4ec9-8046-75d928fba05f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.667816 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f755b93f-3043-4ec9-8046-75d928fba05f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.668690 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f755b93f-3043-4ec9-8046-75d928fba05f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.669168 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f755b93f-3043-4ec9-8046-75d928fba05f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.810388 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f755b93f-3043-4ec9-8046-75d928fba05f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158081 May 12 19:01:46.811609 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 145/298] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:01:46 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:46.841778 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:46.842516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:46.851659 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.852113 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.853096 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:46.853551 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:46.904208 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:46.926811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:46.928375 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:46.929640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8831ea56-96ee-49e3-8882-ac68702b9a86 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.320421 May 12 19:01:46.933567 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 154/299] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:46 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:47.071228 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:47.079324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-71401115-b4a6-4d51-bd8c-78736bb4a442 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.265616 May 12 19:01:47.089139 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 146/300] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:46 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:47.159501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:47.160270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:47.167760 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.168496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.169626 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.170120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.321738 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:47.323566 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:47.333894 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.337845 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.338761 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.339280 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.341438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:47.350666 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-12390127-771e-41f0-bea4-1b386827c55f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1502 microversion: 2.1 time: 0.195905 May 12 19:01:47.351444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 155/301] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:47 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:47.371506 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac4fb018-f996-4425-966a-67b1e6b77d6a"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:47.381921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:47.408288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.409668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.411558 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.412012 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.440259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] HTTP exception thrown: Cannot 'attach_volume' instance 1351fe24-18b4-4cb5-b54f-33595df43567 while it is in vm_state rescued May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Request method failure captured: May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: POST /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567/os-volume_attachments HTTP/1.1 May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 74 May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkZ3DcigF-ID2zoLmf1s363r4QO3vxrvUQhwcTQnqDJih2lrCmRgMVtsX4GpNZJg1HEirwReWh9hZaRtvOJGEdXY56qemSBOMjs0s8iQ2IIY0Rw2ZPy_xifAq3NGgdvxE1CEolkngv5KRbpDiIOsXygq85i5f36_14GSCcyF5_OyNo May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:01:47.442768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb2e124562e34719a49be3de45e6cf37", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 1df4257419c4434fa22edb0805c1a204 May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {"volumeAttachment": {"volumeId": "ac4fb018-f996-4425-966a-67b1e6b77d6a"}} May 12 19:01:47.444273 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Cannot 'attach_volume' instance 1351fe24-18b4-4cb5-b54f-33595df43567 while it is in vm_state rescued May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'server_id': '1351fe24-18b4-4cb5-b54f-33595df43567', 'body': {'volumeAttachment': {'volumeId': 'ac4fb018-f996-4425-966a-67b1e6b77d6a'}}} May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1351fe24-18b4-4cb5-b54f-33595df43567 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:01:47.445136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1351fe24-18b4-4cb5-b54f-33595df43567 while it is in vm_state rescued May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:01:47.446367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:01:47.447701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:01:47.447701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:01:47.447701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1351fe24-18b4-4cb5-b54f-33595df43567 while it is in vm_state rescued May 12 19:01:47.447701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:01:47.447701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Returning 409 to user: Cannot 'attach_volume' instance 1351fe24-18b4-4cb5-b54f-33595df43567 while it is in vm_state rescued {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:01:47.447701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a92fc772-9cab-41da-a0dc-d86a3dc767b5 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077647 May 12 19:01:47.449695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 156/302] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:01:47 2022] POST /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567/os-volume_attachments => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 19:01:47.456872 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ec9cb479-71c8-4699-be51-0a7bc2d371e1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:47.457422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ec9cb479-71c8-4699-be51-0a7bc2d371e1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:47.465006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec9cb479-71c8-4699-be51-0a7bc2d371e1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.465502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec9cb479-71c8-4699-be51-0a7bc2d371e1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.466369 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec9cb479-71c8-4699-be51-0a7bc2d371e1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.466809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec9cb479-71c8-4699-be51-0a7bc2d371e1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.574536 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ec9cb479-71c8-4699-be51-0a7bc2d371e1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567/action" status: 202 len: 0 microversion: 2.1 time: 0.123048 May 12 19:01:47.579136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 157/303] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:01:47 2022] POST /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:01:47.601602 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:47.602679 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:47.611501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.613519 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.613800 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:47.614253 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:47.973913 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:47.994606 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c8ae8343-cc23-406b-a420-8e8924f78e04 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.677700 May 12 19:01:48.004040 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 147/304] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:47 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:48.009189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:48.010082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:48.025058 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:48.025792 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:48.027854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:48.028483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:48.029077 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:48.042854 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d86a4ef2-b876-49d7-8d01-45965b444b17 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1510 microversion: 2.1 time: 0.461627 May 12 19:01:48.055547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 158/305] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:47 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:48.107888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:48.108499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:48.117395 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:48.117889 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:48.119235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:48.119751 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:48.258729 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:48.269264 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:48.271227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:48.272608 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0917e90d-d3b9-430c-8ec7-66769c114048 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.267348 May 12 19:01:48.284687 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 148/306] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:48 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:48.352181 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:48.368144 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-40bb4e05-1a6f-493b-b8e3-d9ea1d8a9025 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.272207 May 12 19:01:48.368759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 159/307] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:48 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:48.377679 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-f26d4e8a-43ac-466e-995a-d61efd3c40f3 req-80be60ff-48ad-49f6-aa3a-c63650418350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b7344e-55ce-4f61-9c68-6473e53a5d9f", "tag": "9448ad28-f42c-4629-9127-6323c2e65835"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:48.378614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-f26d4e8a-43ac-466e-995a-d61efd3c40f3 req-80be60ff-48ad-49f6-aa3a-c63650418350 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:48.379061 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-f26d4e8a-43ac-466e-995a-d61efd3c40f3 req-80be60ff-48ad-49f6-aa3a-c63650418350 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:48.400694 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-f26d4e8a-43ac-466e-995a-d61efd3c40f3 req-80be60ff-48ad-49f6-aa3a-c63650418350 service nova] Creating event network-changed:9448ad28-f42c-4629-9127-6323c2e65835 for instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f on hv-cinder-79575 May 12 19:01:48.407076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-f26d4e8a-43ac-466e-995a-d61efd3c40f3 req-80be60ff-48ad-49f6-aa3a-c63650418350 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043968 May 12 19:01:48.411462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 149/308] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:01:49.011792 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:49.012692 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:49.026285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.026734 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.027520 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.027958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.062106 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:49.063707 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:49.083886 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.087199 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.088292 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.088939 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.483077 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:49.493440 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c696e9e7-dc36-4d1d-a360-039883a9fb89 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1314 microversion: 2.1 time: 0.483716 May 12 19:01:49.494086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 160/309] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:49 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:49.504036 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:49.504671 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:49.507464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:49.512301 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.512930 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.513901 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.514447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.521815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-990ff965-e73f-47f9-a32c-f58a2f18cace tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1510 microversion: 2.1 time: 0.464531 May 12 19:01:49.532040 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 150/310] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:49 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:49.549336 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:49.550117 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:49.556497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.557159 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.558135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:49.558722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:49.777882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:49.780704 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:49.787850 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-fce6090c-a986-4efa-b944-873164e9c273 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.254513 May 12 19:01:49.794093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 151/311] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:49 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:49.799009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:49.800272 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:49.801476 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-52a10df5-bee2-4428-82a9-89ee47e2db20 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1741 microversion: 2.20 time: 0.306473 May 12 19:01:49.802253 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 161/312] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:49 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1741 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:50.511462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:50.512074 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:50.518455 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.519404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.520166 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.520605 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.539806 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:50.540427 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:50.546788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.547239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.548021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.548460 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.705002 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:50.712914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-68c84f18-ed98-43b5-8f2f-17bcd5aa2640 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1464 microversion: 2.1 time: 0.205227 May 12 19:01:50.713474 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 152/313] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:50 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:50.718565 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:50.725779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-55fb61af-ee00-41e0-ab02-9d0d092faa43 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1510 microversion: 2.1 time: 0.190042 May 12 19:01:50.726331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 162/314] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:50 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:50.750960 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:50.751464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:50.757895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.758346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.759103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.759534 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.782857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:01:50.805666 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:50.806406 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:50.812157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.812608 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.813381 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.813850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.866887 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f3fe8e2e-7b73-4ba7-ac23-574a98968cbe tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 204 len: 0 microversion: 2.1 time: 0.119334 May 12 19:01:50.867462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 153/315] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:01:50 2022] DELETE /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:01:50.872497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:50.873223 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:50.879625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.880072 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.880840 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:50.881284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:50.982230 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:50.991228 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b3dd63fe-5336-4cb0-8cf6-3add8f68c828 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.189682 May 12 19:01:50.991796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 163/316] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:50 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:50.996141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:50.996746 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:51.002419 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:51.003412 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:51.004179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:51.004608 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:51.028152 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:51.035974 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:51.037463 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:51.038901 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6da7d74b-a9e8-4a73-b26f-f2815bd00097 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1723 microversion: 2.20 time: 0.170382 May 12 19:01:51.039458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 154/317] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:50 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:51.128584 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:51.135831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8f40134d-5d79-41ef-938c-361c4142e45b tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1470 microversion: 2.1 time: 0.143107 May 12 19:01:51.136392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 164/318] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:50 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1470 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:51.743152 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:51.743760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:51.750511 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:51.750968 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:51.751949 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:51.752388 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:51.957610 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:51.964919 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f573ec3f-55ea-4a05-8c91-30ca9c19e190 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1510 microversion: 2.1 time: 0.225567 May 12 19:01:51.965474 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 155/319] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:51 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:52.008451 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:52.009064 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:52.015541 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.015987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:52.016745 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.017176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:52.056582 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:52.057197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:52.063289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.063737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:52.064522 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.064962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:52.192010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:52.199701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-605e4b02-ce9e-4d2c-b3c5-05c56a8e7f42 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.194993 May 12 19:01:52.200299 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 165/320] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:52 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:52.204840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:52.205388 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:52.211033 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.211477 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:52.212242 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.212675 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:52.220920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:52.228558 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:52.230059 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:52.231200 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-26b2766a-d466-4d10-9996-aa1abfa20acc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1723 microversion: 2.20 time: 0.178445 May 12 19:01:52.231932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 156/321] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:52 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:52.341003 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:52.348311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-455a937e-c361-4f77-bb22-5003856d34b5 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1470 microversion: 2.1 time: 0.146954 May 12 19:01:52.349106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 166/322] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:52 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:52.982072 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:52.982816 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:52.989895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.990342 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:52.991102 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:52.991534 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.117244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:53.124697 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e9cd3a92-1f03-4cce-8650-f61035e60197 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1510 microversion: 2.1 time: 0.146559 May 12 19:01:53.125260 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 157/323] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:52 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:53.216098 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:53.216747 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:53.223780 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:53.224237 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.225021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:53.225555 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.249366 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:53.250012 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:53.264939 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:53.265392 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.266216 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:53.266644 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.481416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:53.489899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1adbc0cc-754d-4c38-b13b-ee68a12adf40 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.277567 May 12 19:01:53.490468 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 167/324] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:53 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:53.494944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:53.495561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:53.496735 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:53.501830 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:53.502287 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.503089 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:53.503531 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.505688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:53.507457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:53.508607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1f1b5700-fca2-428e-a2bc-dedde6a65c2f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1723 microversion: 2.20 time: 0.263079 May 12 19:01:53.515594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 158/325] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:53 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:53.697875 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:53.706372 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b8ae5298-b01d-4bd4-a0ae-226d30628aad tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1470 microversion: 2.1 time: 0.214412 May 12 19:01:53.706940 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 168/326] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:53 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:53.758585 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-dd5462d8-17bd-4575-a568-29f0fc6641d8 req-7daea489-d504-4c06-bd3d-ef1648d7550b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fae6df-666d-4354-9089-87b51631cb48", "name": "network-vif-unplugged", "status": "completed", "tag": "1abe14a4-11ef-449b-a24c-786cad5c7d21"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:53.767590 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-dd5462d8-17bd-4575-a568-29f0fc6641d8 req-7daea489-d504-4c06-bd3d-ef1648d7550b service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:53.768035 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-dd5462d8-17bd-4575-a568-29f0fc6641d8 req-7daea489-d504-4c06-bd3d-ef1648d7550b service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:53.780395 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-dd5462d8-17bd-4575-a568-29f0fc6641d8 req-7daea489-d504-4c06-bd3d-ef1648d7550b service nova] Creating event network-vif-unplugged:1abe14a4-11ef-449b-a24c-786cad5c7d21 for instance f3fae6df-666d-4354-9089-87b51631cb48 on hv-cinder-79575 May 12 19:01:53.785928 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-dd5462d8-17bd-4575-a568-29f0fc6641d8 req-7daea489-d504-4c06-bd3d-ef1648d7550b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031338 May 12 19:01:53.786681 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 159/327] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:54.142390 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:54.143000 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:54.150071 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:54.150518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:54.151554 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:54.151990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:54.460725 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:54.467993 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4e0f7daa-ef2b-4a70-bc4f-c591c1c9c389 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1516 microversion: 2.1 time: 0.329419 May 12 19:01:54.468576 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 169/328] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:54 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:54.508675 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:54.509965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:54.516001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:54.516445 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:54.517204 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:54.517661 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:54.526911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:54.527520 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:54.537016 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:54.537456 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:54.545951 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:54.546405 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:55.188138 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:55.195943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5c6895b9-c1a0-43f1-b302-72e891c25dac tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.692030 May 12 19:01:55.196509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 160/329] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:54 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:55.200817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:55.201457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:55.208618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:55.209196 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:55.210072 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:55.210876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:55.211540 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:55.219514 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:55.221059 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:55.223074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ad768cef-d670-4080-a7c6-42491d8f6fd4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1723 microversion: 2.20 time: 0.700403 May 12 19:01:55.223700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 170/330] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:54 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1723 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:01:55.444190 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:55.451934 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-65376c40-e99a-4fca-877d-81e02afb2443 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1470 microversion: 2.1 time: 0.254437 May 12 19:01:55.453370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 161/331] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:55 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:55.509450 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-8fbe38cd-9157-4cab-8908-2a3b20ba6cfe req-5b5c6afa-dbaf-4c49-a52e-bcc2cd0ace40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2967ef0-5b49-4af3-b3c2-5fb91e845621", "name": "network-vif-deleted", "tag": "fc346978-3d3f-40f6-81be-74a96fef5c7d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:55.518476 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-8fbe38cd-9157-4cab-8908-2a3b20ba6cfe req-5b5c6afa-dbaf-4c49-a52e-bcc2cd0ace40 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:55.519255 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-8fbe38cd-9157-4cab-8908-2a3b20ba6cfe req-5b5c6afa-dbaf-4c49-a52e-bcc2cd0ace40 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:55.530538 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-8fbe38cd-9157-4cab-8908-2a3b20ba6cfe req-5b5c6afa-dbaf-4c49-a52e-bcc2cd0ace40 service nova] Creating event network-vif-deleted:fc346978-3d3f-40f6-81be-74a96fef5c7d for instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 on hv-cinder-79575 May 12 19:01:55.536254 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-8fbe38cd-9157-4cab-8908-2a3b20ba6cfe req-5b5c6afa-dbaf-4c49-a52e-bcc2cd0ace40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030417 May 12 19:01:55.536849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 171/332] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:55.818838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bc3c3591-7ee7-4d32-a812-6149ab2d6ec1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'create', calling method: .version_select at 0x7f38c25edaf0>, body: {"keypair": {"name": "tempest-keypair-778954759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMwipVO6mj/W3VEpRiiJaZkHIYXg4kriBPyvD4iAhLjrZr6r6xRE1OOML28ocDt3i861JnG1PMT2lUGK3yLIj5FAgAUbgGrVNZaQu7+SCbfw3VfXrpAK09dGgo6VKzadA=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:55.839959 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-bc3c3591-7ee7-4d32-a812-6149ab2d6ec1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for project eb2e124562e34719a49be3de45e6cf37. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:01:55.843673 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-bc3c3591-7ee7-4d32-a812-6149ab2d6ec1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for user 1df4257419c4434fa22edb0805c1a204 and project eb2e124562e34719a49be3de45e6cf37. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:01:55.864983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bc3c3591-7ee7-4d32-a812-6149ab2d6ec1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050359 May 12 19:01:55.865550 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 162/333] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:01:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:01:56.214159 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:56.214863 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:56.220837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:56.221887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:56.222708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:56.223146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:56.243324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:56.244134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:56.250296 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:56.250751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:56.251531 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:56.251965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:56.492056 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:56.499796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5f993197-84bb-401b-822a-5f67b3c47143 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.290871 May 12 19:01:56.500369 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 172/334] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:56 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:56.505037 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:56.505668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:56.506746 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:56.512706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:56.513264 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:56.514258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:56.514701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:56.516784 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:56.518434 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:56.519718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a82b6ffb-19b5-4ff7-814a-30ba034118d1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1723 microversion: 2.20 time: 0.282097 May 12 19:01:56.520640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 163/335] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:56 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:56.581806 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:56.589071 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4f560615-abe4-4bf1-a278-33e2c03c1a6d tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1428 microversion: 2.1 time: 0.087771 May 12 19:01:56.589658 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 173/336] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:56 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:57.311701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1248346910", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6591bd39-6d3d-40fe-a449-357cebc4a65e"}], "security_groups": [{"name": "tempest-securitygroup--345364139"}], "key_name": "tempest-keypair-778954759", "user_data": "}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:57.409481 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] validate_networks() for [('6591bd39-6d3d-40fe-a449-357cebc4a65e', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:01:57.517546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:57.518389 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:57.526264 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.526794 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:57.527641 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.528141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:57.750612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:57.758883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b55d8cdb-ce58-4601-8bbc-b1a1559a7c04 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.246656 May 12 19:01:57.759451 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 174/337] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:57 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:01:57.763854 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:57.764455 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:57.770525 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.770972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:57.771733 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.772169 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:57.901093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:01:57.901642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:01:57.902212 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:01:57.902794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:01:57.903276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:01:57.912386 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.913167 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:57.914076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.914672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:57.939200 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for project eb2e124562e34719a49be3de45e6cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:01:57.943831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Getting quotas for user 1df4257419c4434fa22edb0805c1a204 and project eb2e124562e34719a49be3de45e6cf37. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:01:57.945848 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:57.955528 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:01:57.958204 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:01:57.961148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:57.965869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:57.969403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-38024271-1f0c-47e9-9c55-9dc4f45c3641 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1726 microversion: 2.20 time: 0.208970 May 12 19:01:57.981550 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 175/338] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:57 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:57.981550 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:57.981550 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:57.989123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.989829 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:57.990730 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:57.991391 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.025217 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-78f28eac-95b8-4499-a526-59e88751cc12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.717758 May 12 19:01:58.030855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 164/339] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:01:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 19:01:58.031472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-17b374af-ebbc-4e0b-b21d-fa290047d14d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3afe106-49c8-4331-84d7-fca0dacf62f5"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:58.032760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-17b374af-ebbc-4e0b-b21d-fa290047d14d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:58.036123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.036578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.037027 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lazy-loading 'fault' on Instance uuid a2967ef0-5b49-4af3-b3c2-5fb91e845621 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:01:58.039894 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-17b374af-ebbc-4e0b-b21d-fa290047d14d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.040359 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-17b374af-ebbc-4e0b-b21d-fa290047d14d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.041169 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-17b374af-ebbc-4e0b-b21d-fa290047d14d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.041628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-17b374af-ebbc-4e0b-b21d-fa290047d14d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.094735 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32c7724a2f74e0fa25b0f596be7c81b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e982ed51d9445b8f05cb7ddee40660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:58.102318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f0ea2cb1-5543-42c4-bb2d-e2ab6b1bdcaf tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 200 len: 1304 microversion: 2.1 time: 0.131097 May 12 19:01:58.103561 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 176/340] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:57 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:58.108687 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8b032dd0-fec7-4b50-b4ca-c4cc46287bc4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:58.109469 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8b032dd0-fec7-4b50-b4ca-c4cc46287bc4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:58.167183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8b032dd0-fec7-4b50-b4ca-c4cc46287bc4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:58.173807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8b032dd0-fec7-4b50-b4ca-c4cc46287bc4 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1245 microversion: 2.1 time: 0.069023 May 12 19:01:58.174943 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 177/341] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:58 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:58.356052 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-17b374af-ebbc-4e0b-b21d-fa290047d14d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.328547 May 12 19:01:58.356805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 165/342] 10.222.0.48 () {62 vars in 1363 bytes} [Thu May 12 19:01:58 2022] POST /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments => generated 188 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:01:58.471046 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c68bf5f8-a3c1-4531-9418-813d9bd4ffd5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:01:58.472324 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c68bf5f8-a3c1-4531-9418-813d9bd4ffd5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:58.480707 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c68bf5f8-a3c1-4531-9418-813d9bd4ffd5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.481160 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c68bf5f8-a3c1-4531-9418-813d9bd4ffd5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.481962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c68bf5f8-a3c1-4531-9418-813d9bd4ffd5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.482397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c68bf5f8-a3c1-4531-9418-813d9bd4ffd5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.577095 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c68bf5f8-a3c1-4531-9418-813d9bd4ffd5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/action" status: 202 len: 0 microversion: 2.20 time: 0.109935 May 12 19:01:58.578023 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 178/343] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 12 19:01:58 2022] POST /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 19:01:58.586298 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:58.586933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:58.592810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.593518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.594333 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.594769 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.738461 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:58.746720 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:58.748227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:58.749367 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-91d7c319-ea4a-4f6e-bdf3-c7441a2b65e9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1752 microversion: 2.20 time: 0.166983 May 12 19:01:58.749954 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 166/344] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:58 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:01:58.775141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:58.775842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:58.781651 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.782102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.782871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:58.783308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:58.914691 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:58.922797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-99995002-d191-44f9-982d-d272b11f1c34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.151536 May 12 19:01:58.923434 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 179/345] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:58 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:59.121165 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:59.121882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] [instance: a2967ef0-5b49-4af3-b3c2-5fb91e845621] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:59.129347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.130088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:59.130786 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.131584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:59.146113 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] HTTP exception thrown: Instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 could not be found. May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Request method failure captured: May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 HTTP/1.1 May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVmLdE_UsVNmV2Qv5OAd2FSiEdbIJVCkKJmcC9OQxd2BFHoRu5NRxveR9MooUQUp8WfJuItw_tNeRA54otV4_rdoUoUyfE2mrA-yymlVt2b1nOR9b6uJ_UUtpGqjIhLRsdeAOUfY5RJ6YhLYoYvCQ9snVPmdZvVY_KsZALtUdpQFrJ8 May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: b1e982ed51d9445b8f05cb7ddee40660 May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-VolumesNegativeTest-1148354372 May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:01:59.147909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1e982ed51d9445b8f05cb7ddee40660", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1e982ed51d9445b8f05cb7ddee40660"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1e982ed51d9445b8f05cb7ddee40660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1e982ed51d9445b8f05cb7ddee40660"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-VolumesNegativeTest-1148354372 May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: b1e982ed51d9445b8f05cb7ddee40660 May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-VolumesNegativeTest-1148354372 May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-VolumesNegativeTest-1148354372-project May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e32c7724a2f74e0fa25b0f596be7c81b May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-VolumesNegativeTest-1148354372-project May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 could not be found. May 12 19:01:59.149458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'a2967ef0-5b49-4af3-b3c2-5fb91e845621'} May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 could not be found. May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:01:59.150364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 could not be found. May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 could not be found. May 12 19:01:59.151751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:01:59.152983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] Returning 404 to user: Instance a2967ef0-5b49-4af3-b3c2-5fb91e845621 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:01:59.152983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d9494d88-733a-4c10-9bb5-ab706d6502c3 tempest-VolumesNegativeTest-1148354372 tempest-VolumesNegativeTest-1148354372-project] 10.222.0.48 "GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621" status: 404 len: 111 microversion: 2.1 time: 0.032721 May 12 19:01:59.152983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 167/346] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:59 2022] GET /compute/v2.1/servers/a2967ef0-5b49-4af3-b3c2-5fb91e845621 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:01:59.192998 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:59.193701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:59.200205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.200802 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:59.201700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.202342 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:59.295693 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:01:59.304566 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6b5c67c0-deeb-4da7-b003-ca12bbd1f00d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1305 microversion: 2.1 time: 0.117696 May 12 19:01:59.305150 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 180/347] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:59 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:01:59.770467 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:59.771805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:59.781041 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.781760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:59.782699 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.783292 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:59.938750 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:01:59.939358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:01:59.945953 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.946400 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:01:59.947339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:01:59.947924 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:00.025401 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:00.035674 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:00.038369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:00.040006 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f916b4f5-84c0-4e52-b6fd-db3e3e749be1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1752 microversion: 2.20 time: 0.275513 May 12 19:02:00.040999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 168/348] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:01:59 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1752 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:00.184891 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:00.193384 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-21a7b7fc-d51a-4a06-b7ca-e219d1e382d7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.258408 May 12 19:02:00.194005 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 181/349] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:01:59 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:00.325176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:00.326453 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:00.338827 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:00.339268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:00.340045 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:00.347067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:00.554590 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:00.571221 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f7c20fb0-5768-4618-9681-2fd89440027a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.253058 May 12 19:02:00.572377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 169/350] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:00 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:01.059319 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:01.060949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:01.069690 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:01.069690 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:01.069874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:01.070194 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:01.212440 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:01.213068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:01.223732 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:01.224181 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:01.224964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:01.225552 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:01.400041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:01.410308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:01.412183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:01.414432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6736717b-c8e5-4995-80f8-a7b6d88eea9d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.359094 May 12 19:02:01.415285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 182/351] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:01 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:01.421235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-b4f24827-8e5d-4c43-839e-03d979e95442 req-387a3b8e-ff1f-4a78-b3cb-4c2407062846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665565c6-dd25-45be-b6a5-db7fddff10cf", "tag": "521e204c-fea5-47a9-a561-25d5d27a554a"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:01.432405 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b4f24827-8e5d-4c43-839e-03d979e95442 req-387a3b8e-ff1f-4a78-b3cb-4c2407062846 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:01.433340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b4f24827-8e5d-4c43-839e-03d979e95442 req-387a3b8e-ff1f-4a78-b3cb-4c2407062846 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:01.448185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-b4f24827-8e5d-4c43-839e-03d979e95442 req-387a3b8e-ff1f-4a78-b3cb-4c2407062846 service nova] Creating event network-changed:521e204c-fea5-47a9-a561-25d5d27a554a for instance 665565c6-dd25-45be-b6a5-db7fddff10cf on hv-cinder-79575 May 12 19:02:01.453113 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-b4f24827-8e5d-4c43-839e-03d979e95442 req-387a3b8e-ff1f-4a78-b3cb-4c2407062846 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036333 May 12 19:02:01.453944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 183/352] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:01.591433 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:01.596399 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:01.597123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:01.607803 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dc07bf1a-3366-4692-9f84-6a8e09f6c30e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.398259 May 12 19:02:01.608600 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 170/353] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:01 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:01.609067 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:01.609898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:01.610695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:01.611134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:02.202956 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:02.210695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-31388f28-904e-469c-b748-30ddd2c870aa tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.624968 May 12 19:02:02.211453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 184/354] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:01 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:02.433417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:02.434056 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:02.440843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:02.441289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:02.442085 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:02.442521 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:02.625466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:02.626117 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:02.632474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:02.632931 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:02.633747 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:02.634192 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:02.637773 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:02.647027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:02.648767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:02.649982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7ee519a7-be81-425a-8fff-7916bdd00da4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.220414 May 12 19:02:02.650710 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 171/355] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:02 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:02.765975 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:02.773688 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8ec07c89-8d89-45c1-a574-fe78be25b841 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.152097 May 12 19:02:02.774247 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 185/356] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:02 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:03.228358 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:03.229041 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:03.235017 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:03.235470 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:03.236971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:03.237458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:03.363596 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:03.370824 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-42e9fc39-9712-4ac9-bd09-dd95ffac274e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.147018 May 12 19:02:03.371382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 172/357] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:03 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:03.668428 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:03.669078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:03.675872 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:03.676331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:03.677115 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:03.677577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:03.793374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:03.795085 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:03.802971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:03.803802 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:03.804900 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:03.805665 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:03.999020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:04.009140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:04.010736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:04.011986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1ecb844b-be90-47fd-9d2f-e7ca15af1004 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.347426 May 12 19:02:04.012564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 186/358] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:03 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:04.030036 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:04.038575 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1529e64e-3c2f-4933-8f1b-dc5ff1185e2a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1723 microversion: 2.1 time: 0.251927 May 12 19:02:04.039135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 173/359] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:03 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:04.389368 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:04.390297 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:04.397877 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:04.398324 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:04.399606 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:04.400051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:04.557703 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:04.566085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-734c5e76-6c21-4cae-8d65-4c5e3d22180c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.181928 May 12 19:02:04.566665 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 187/360] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:04 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:05.030146 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:05.030995 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:05.039316 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.040008 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.040795 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.041235 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.055522 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:05.056241 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:05.062647 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.063104 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.063887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.064332 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.255701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:05.262564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:05.267901 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:05.269594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:05.270869 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-659d74fc-f2b5-45ac-905e-3922f54ff900 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.244696 May 12 19:02:05.271871 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 174/361] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:05 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:05.272924 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bb827b05-308f-4970-a9c5-e23ea39a05b3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1700 microversion: 2.1 time: 0.221195 May 12 19:02:05.273492 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 188/362] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:05 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1700 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:05.290418 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6554ab2a-bc8a-408c-8268-cbe6b849ac8d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:05.297161 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6554ab2a-bc8a-408c-8268-cbe6b849ac8d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.297645 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6554ab2a-bc8a-408c-8268-cbe6b849ac8d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.361282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6554ab2a-bc8a-408c-8268-cbe6b849ac8d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Going to try to start instance {{(pid=117101) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 19:02:05.407839 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6554ab2a-bc8a-408c-8268-cbe6b849ac8d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action" status: 202 len: 0 microversion: 2.1 time: 0.121186 May 12 19:02:05.411888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 175/363] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:02:05 2022] POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:02:05.417784 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:05.418407 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:05.424735 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.425191 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.426021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.426467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.562609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:05.570759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f93d2679-7834-4e24-a15f-7a36dff36860 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.156902 May 12 19:02:05.571517 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 189/364] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:05 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:05.586945 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:05.587648 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:05.594205 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.594657 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.596228 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.596897 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.741486 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:05.749773 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-09c93bc4-75d6-42e1-b89f-2bfd109da6c7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.166973 May 12 19:02:05.759358 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 176/365] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:05 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:05.904536 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-da3a8292-2e51-43e1-a791-bb32ccaf99b9 req-063f7638-6d05-4944-9718-5f174774554d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665565c6-dd25-45be-b6a5-db7fddff10cf", "name": "network-vif-plugged", "status": "completed", "tag": "521e204c-fea5-47a9-a561-25d5d27a554a"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:05.921265 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-da3a8292-2e51-43e1-a791-bb32ccaf99b9 req-063f7638-6d05-4944-9718-5f174774554d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:05.921728 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-da3a8292-2e51-43e1-a791-bb32ccaf99b9 req-063f7638-6d05-4944-9718-5f174774554d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:05.935319 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-da3a8292-2e51-43e1-a791-bb32ccaf99b9 req-063f7638-6d05-4944-9718-5f174774554d service nova] Creating event network-vif-plugged:521e204c-fea5-47a9-a561-25d5d27a554a for instance 665565c6-dd25-45be-b6a5-db7fddff10cf on hv-cinder-79575 May 12 19:02:05.942211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-da3a8292-2e51-43e1-a791-bb32ccaf99b9 req-063f7638-6d05-4944-9718-5f174774554d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042756 May 12 19:02:05.943387 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 190/366] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:06.289475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:06.290022 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:06.296431 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:06.296879 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:06.297694 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:06.298129 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:06.446278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:06.456325 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:06.458076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:06.459344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-cb856783-a7c6-4164-a68a-06f56f66da7c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.174082 May 12 19:02:06.470819 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 177/367] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:06 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:06.588646 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:06.589352 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:06.596248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:06.596798 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:06.597682 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:06.598209 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:06.739560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:06.748967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e563d54c-54cf-4304-a3f0-b935d98115ce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.164449 May 12 19:02:06.749758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 191/368] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:06 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:06.767111 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:06.767728 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:06.774189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:06.774636 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:06.775419 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:06.775859 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:06.943773 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:06.951713 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-740e455c-e178-41a3-885a-a3fdf421cd63 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.188549 May 12 19:02:06.952293 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 178/369] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:06 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:07.477977 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:07.478589 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:07.484559 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:07.485013 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:07.485818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:07.486768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:07.621428 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:07.630349 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:07.631848 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:07.633017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b45481a4-3012-415f-b641-a7810c3a4ac8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.158933 May 12 19:02:07.633628 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 192/370] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:07 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:07.766879 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:07.767573 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:07.773663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:07.774114 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:07.774872 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:07.775307 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:07.913518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:07.921449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-895ff7fa-282a-46cf-8962-290ffee1047f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.158478 May 12 19:02:07.922049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 179/371] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:07 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:07.969684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:07.970326 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:07.977154 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:07.977796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:07.978618 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:07.979085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:08.118800 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:08.130383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3595d80e-a773-4b3f-b382-e902a4f230dd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.164452 May 12 19:02:08.131180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 193/372] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:07 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:08.651406 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:08.652083 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:08.658509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:08.658966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:08.659772 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:08.660211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:08.800848 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:08.809610 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:08.811098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:08.812262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b9e4d624-b59f-4c78-a7bd-647e336d670b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.164833 May 12 19:02:08.812820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 180/373] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:08 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:08.939671 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:08.940296 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:08.946728 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:08.947182 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:08.947967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:08.948409 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:09.080350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:09.088817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-09bbca66-1001-491d-8ad5-53c10bf347e7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.153013 May 12 19:02:09.089488 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 194/374] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:08 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:09.148328 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:09.148975 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:09.154965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:09.155408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:09.156170 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:09.156598 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:09.290053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:09.297607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c847f689-d65b-40e3-848f-9ba91561e4ec tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.153501 May 12 19:02:09.298212 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 181/375] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:09 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:09.832233 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:09.833022 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:09.839440 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:09.839892 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:09.840682 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:09.841123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:09.991170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:10.007736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:10.009266 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:10.011714 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c332a934-1931-47f3-91ca-631ae66f56ce tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.183297 May 12 19:02:10.012564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 195/376] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:09 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:10.106807 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:10.107527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:10.118076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:10.118526 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:10.119342 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:10.119776 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:10.259833 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:10.268508 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-de150808-b96e-4ef6-8133-e32d557ab09e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.165634 May 12 19:02:10.269089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 182/377] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:10 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:10.315057 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:10.315672 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:10.321848 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:10.322311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:10.323105 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:10.323544 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:10.463598 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:10.471783 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0c7ab3d4-fe93-4d7e-bb75-3e53cfb01cb0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.160825 May 12 19:02:10.472614 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 196/378] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:10 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:11.038719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:11.039339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:11.045716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:11.046166 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:11.047983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:11.049476 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:11.199004 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:11.206829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:11.208346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:11.209726 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dfd2e0d2-6ea3-4000-8c93-b87c01c862f1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.183263 May 12 19:02:11.210502 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 183/379] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:11 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:11.285194 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:11.286009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:11.292983 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:11.293512 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:11.294467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:11.294965 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:11.440462 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:11.448730 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-17c1e103-9a67-4413-b237-a12e21496701 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.167505 May 12 19:02:11.449320 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 197/380] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:11 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:11.489444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:11.490194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:11.496576 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:11.497029 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:11.497839 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:11.498281 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:11.638199 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:11.646807 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3cc6d785-f8d6-482c-ae87-8d5f7043d2a0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.161067 May 12 19:02:11.652669 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 184/381] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:11 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:12.227398 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:12.228015 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:12.234038 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:12.234490 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:12.235259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:12.235698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:12.390321 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:12.399118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:12.400618 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:12.401821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3ab7d460-bc01-4878-be19-3f1ac9e27add tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.178466 May 12 19:02:12.405125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 198/382] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:12 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:12.466127 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:12.466817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:12.474827 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:12.475580 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:12.476530 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:12.477121 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:12.616213 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:12.624389 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-795c4fd8-17e6-480d-beaa-f7353d686783 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.162325 May 12 19:02:12.624951 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 185/383] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:12 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:12.665750 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:12.666963 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:12.673539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:12.674092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:12.674949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:12.675471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:12.811577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:12.819420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-29596ec3-5bc5-4e63-a608-fa8b8612fa16 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.158485 May 12 19:02:12.820005 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 199/384] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:12 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:13.421538 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:13.422180 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:13.429604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:13.430049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:13.430829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:13.431267 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:13.563428 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:13.572205 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:13.573723 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:13.574888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-16804288-e1f6-4660-97c8-a72e1342d190 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.157375 May 12 19:02:13.575454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 186/385] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:13 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:13.642010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:13.642619 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:13.648895 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:13.649342 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:13.650134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:13.650569 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:13.775599 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:13.783776 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-63099056-972c-4099-8c5d-fce5e2c9e806 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.145570 May 12 19:02:13.784332 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 200/386] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:13 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:13.835837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:13.836472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:13.842320 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:13.842754 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:13.843507 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:13.843937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:13.973933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:13.981219 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-938d5e27-5228-4fe6-93aa-7326d597fef6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.149064 May 12 19:02:13.981761 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 187/387] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:13 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:14.592508 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:14.593031 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:14.599264 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:14.599712 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:14.600470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:14.600900 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:14.738910 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:14.746991 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:14.748464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:14.749638 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4f92f2d1-6996-4df4-8a11-20a794196e8f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.161169 May 12 19:02:14.750201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 201/388] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:14 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:14.799918 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:14.800552 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:14.806878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:14.807329 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:14.808100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:14.808536 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:14.932647 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:14.941000 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-828bf3b1-dcab-4066-ace1-1947eb806af0 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.144895 May 12 19:02:14.941582 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 188/389] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:14 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:14.997985 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:14.998598 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:15.004437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:15.004888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:15.005685 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:15.006125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:15.194925 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:15.202384 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e1fd1b02-920a-4767-9e23-740f428a9c86 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1370 microversion: 2.1 time: 0.208225 May 12 19:02:15.202981 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 202/390] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:14 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:15.766628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:15.767242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:15.773107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:15.773577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:15.774339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:15.774775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:15.903517 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:15.911680 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:15.913432 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:15.914599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8d50c502-6333-4053-b5cf-ae95d7a0d2af tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.151838 May 12 19:02:15.915153 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 189/391] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:15 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:15.958624 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:15.959240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:15.965650 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:15.966109 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:15.966899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:15.967322 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:16.096607 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:16.104466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-06aefc3f-0ee0-49e3-8d2f-c47b104ee1df tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.150349 May 12 19:02:16.105027 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 203/392] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:15 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:16.220143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:16.220759 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:16.226659 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:16.227110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:16.230812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:16.231762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:16.356979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:16.364688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-302a42ee-b66b-47d1-a76f-7c0d99aac984 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1564 microversion: 2.1 time: 0.148459 May 12 19:02:16.365251 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 190/393] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:16 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:16.380851 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9cb03d69-f9bb-4874-8c1f-5432bb1d4633 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:16.381341 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9cb03d69-f9bb-4874-8c1f-5432bb1d4633 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:16.387779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9cb03d69-f9bb-4874-8c1f-5432bb1d4633 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:16.388221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9cb03d69-f9bb-4874-8c1f-5432bb1d4633 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:16.388980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9cb03d69-f9bb-4874-8c1f-5432bb1d4633 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:16.389409 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9cb03d69-f9bb-4874-8c1f-5432bb1d4633 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:16.466464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9cb03d69-f9bb-4874-8c1f-5432bb1d4633 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089442 May 12 19:02:16.467059 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 204/394] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:02:16 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:16.932543 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:16.933159 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:16.940487 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:16.940938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:16.941754 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:16.942195 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:17.122205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:17.123385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:17.130012 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:17.130467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:17.131256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:17.131681 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:17.190006 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:17.198793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:17.200290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:17.201449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-97682c5d-a259-49be-8819-2608174ab0e7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.272853 May 12 19:02:17.202252 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 191/395] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:16 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:17.388132 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:17.395947 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9dc4d04f-647d-4ed1-a130-b8b30fed4888 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1709 microversion: 2.1 time: 0.278122 May 12 19:02:17.396523 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 205/396] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:17 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1709 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:17.811943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-62c69e65-0da2-433a-8441-05bdf3b54ad0 req-30113260-79c4-40db-908e-e03a0a8faca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665565c6-dd25-45be-b6a5-db7fddff10cf", "tag": "521e204c-fea5-47a9-a561-25d5d27a554a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:17.820529 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-62c69e65-0da2-433a-8441-05bdf3b54ad0 req-30113260-79c4-40db-908e-e03a0a8faca5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:17.820975 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-62c69e65-0da2-433a-8441-05bdf3b54ad0 req-30113260-79c4-40db-908e-e03a0a8faca5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:17.831512 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-62c69e65-0da2-433a-8441-05bdf3b54ad0 req-30113260-79c4-40db-908e-e03a0a8faca5 service nova] Creating event network-changed:521e204c-fea5-47a9-a561-25d5d27a554a for instance 665565c6-dd25-45be-b6a5-db7fddff10cf on hv-cinder-79575 May 12 19:02:17.836679 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-62c69e65-0da2-433a-8441-05bdf3b54ad0 req-30113260-79c4-40db-908e-e03a0a8faca5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028362 May 12 19:02:17.837410 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 192/397] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:18.220949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:18.221675 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:18.228533 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:18.228982 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:18.229827 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:18.230240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:18.414474 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:18.415797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:18.422365 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:18.423568 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:18.424529 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:18.425125 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:18.429654 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:18.440425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:18.442196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:18.443900 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c2e19241-e8f6-4605-93b2-9a526619ced7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.227253 May 12 19:02:18.455862 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 206/398] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:18 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:18.578424 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:18.588266 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ce201f29-3035-4f8f-a282-16a31d3edd34 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1713 microversion: 2.1 time: 0.178917 May 12 19:02:18.589048 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 193/399] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:18 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1713 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:02:19.462512 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:19.463133 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:19.469447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:19.469965 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:19.470736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:19.471184 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:19.595961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:19.604131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:19.605659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:19.606816 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ae109a02-3372-44f0-9b8f-5624d04d207b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.148212 May 12 19:02:19.607387 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 207/400] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:19 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:20.625177 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:20.625819 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:20.632110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:20.632565 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:20.633337 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:20.633809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:20.761721 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:20.770386 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:20.771866 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:20.773011 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f5422e6d-ac6e-477b-aaa2-f1529171c3a7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.151698 May 12 19:02:20.773591 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 194/401] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:20 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:21.791681 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:21.792288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:21.800084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:21.800533 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:21.801300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:21.801776 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:21.926220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:21.934477 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:21.936003 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:21.937158 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-69c376af-c9dc-4ed6-b706-904b93814bc3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.149358 May 12 19:02:21.937964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 208/402] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:21 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:22.956054 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:22.956669 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:22.962944 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:22.963397 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:22.964171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:22.964611 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:23.096602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:23.104945 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:23.106475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:23.107630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-80b7b3c0-a828-46f9-a3ef-eb1e1f56fa52 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.155987 May 12 19:02:23.108188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 195/403] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:22 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:23.958033 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-84cb2cba-1c0e-4567-b02b-5b3ac1613966 req-7f764dec-3c50-4f75-8d5d-2dda3a23a3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fae6df-666d-4354-9089-87b51631cb48", "name": "network-vif-plugged", "status": "completed", "tag": "1abe14a4-11ef-449b-a24c-786cad5c7d21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:23.966534 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-84cb2cba-1c0e-4567-b02b-5b3ac1613966 req-7f764dec-3c50-4f75-8d5d-2dda3a23a3db service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:23.967007 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-84cb2cba-1c0e-4567-b02b-5b3ac1613966 req-7f764dec-3c50-4f75-8d5d-2dda3a23a3db service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:23.982437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-84cb2cba-1c0e-4567-b02b-5b3ac1613966 req-7f764dec-3c50-4f75-8d5d-2dda3a23a3db service nova] Creating event network-vif-plugged:1abe14a4-11ef-449b-a24c-786cad5c7d21 for instance f3fae6df-666d-4354-9089-87b51631cb48 on hv-cinder-79575 May 12 19:02:23.984895 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-84cb2cba-1c0e-4567-b02b-5b3ac1613966 req-7f764dec-3c50-4f75-8d5d-2dda3a23a3db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030421 May 12 19:02:23.986057 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 209/404] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:24.125674 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:24.126184 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:24.132863 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:24.133306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:24.134179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:24.134609 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:24.263073 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:24.272171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:24.273669 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:24.274811 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ec0f1f0e-a132-4cbe-b07a-5fddf05c82d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.153141 May 12 19:02:24.275356 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 196/405] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:24 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:02:25.293341 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:25.294061 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:25.300126 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:25.300570 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:25.301326 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:25.301783 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:25.435008 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:25.443322 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:25.444815 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:25.446119 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ba1a4c11-8777-4a7c-922e-f4ee1aac1806 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.157426 May 12 19:02:25.446680 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 210/406] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:25 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:26.464566 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:26.465215 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:26.471938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:26.472382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:26.473135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:26.473597 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:26.597316 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:26.605443 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:26.606948 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:26.608094 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-679f9b1f-3309-48b0-93e5-b4ff2993222a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1810 microversion: 2.20 time: 0.147403 May 12 19:02:26.608658 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 197/407] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:26 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:27.626952 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:27.627486 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:27.633758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:27.634202 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:27.634962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:27.635398 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:27.764382 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:27.772956 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:27.774482 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:27.775657 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-91655424-43f7-4116-8984-273750de1a69 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1797 microversion: 2.20 time: 0.153270 May 12 19:02:27.776206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 211/408] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:02:27 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1797 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:02:33.397604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-37436c58-8957-478f-847a-3671ea3980a1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:33.398128 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-37436c58-8957-478f-847a-3671ea3980a1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:33.404392 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-37436c58-8957-478f-847a-3671ea3980a1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.404837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-37436c58-8957-478f-847a-3671ea3980a1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.405641 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-37436c58-8957-478f-847a-3671ea3980a1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.406075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-37436c58-8957-478f-847a-3671ea3980a1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.429183 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-37436c58-8957-478f-847a-3671ea3980a1 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035589 May 12 19:02:33.429777 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 198/409] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:02:33 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:33.440016 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b01918f-2d79-41d9-bff6-29c8332d780c"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:33.441110 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:33.448342 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.448797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.449597 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.450036 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.528108 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Invalid volume: volume 0b01918f-2d79-41d9-bff6-29c8332d780c is already attached to instances: 64bcf7c1-c1cd-4149-af79-39ad90968742 May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: POST /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f/os-volume_attachments HTTP/1.1 May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 74 May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:02:33.529842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {"volumeAttachment": {"volumeId": "0b01918f-2d79-41d9-bff6-29c8332d780c"}} May 12 19:02:33.531921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Invalid volume: volume 0b01918f-2d79-41d9-bff6-29c8332d780c is already attached to instances: 64bcf7c1-c1cd-4149-af79-39ad90968742 May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'server_id': '29b7344e-55ce-4f61-9c68-6473e53a5d9f', 'body': {'volumeAttachment': {'volumeId': '0b01918f-2d79-41d9-bff6-29c8332d780c'}}} May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0b01918f-2d79-41d9-bff6-29c8332d780c is already attached to instances: 64bcf7c1-c1cd-4149-af79-39ad90968742 May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:02:33.532879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0b01918f-2d79-41d9-bff6-29c8332d780c is already attached to instances: 64bcf7c1-c1cd-4149-af79-39ad90968742 May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:33.534318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0b01918f-2d79-41d9-bff6-29c8332d780c is already attached to instances: 64bcf7c1-c1cd-4149-af79-39ad90968742 May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 400 to user: Invalid volume: volume 0b01918f-2d79-41d9-bff6-29c8332d780c is already attached to instances: 64bcf7c1-c1cd-4149-af79-39ad90968742 {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9710edeb-1eb9-49dd-92d7-4d080f247321 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095255 May 12 19:02:33.535918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 212/410] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:02:33 2022] POST /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 19:02:33.540899 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:33.541444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:33.547338 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.547780 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.548535 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.548967 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.572391 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:02:33.644771 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-073ee2c0-f47e-4eff-87e1-982a7fe04d3c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 204 len: 0 microversion: 2.1 time: 0.107501 May 12 19:02:33.645409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 199/411] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:02:33 2022] DELETE /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:02:33.655308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:33.655849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:33.662539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.662987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.663746 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:33.664178 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:33.793756 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:33.802172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b0011883-f578-46f9-b672-7651d1a9cb7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1681 microversion: 2.1 time: 0.151227 May 12 19:02:33.803022 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 213/412] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:33 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:34.819694 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:34.820387 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:34.826677 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:34.827151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:34.827909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:34.828383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:34.956315 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:34.963664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e212272e-a7fd-4546-b336-57a76fef32b9 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1681 microversion: 2.1 time: 0.148156 May 12 19:02:34.964216 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 200/413] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:34 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:35.981442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:35.982090 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:35.989786 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:35.990231 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:35.991007 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:35.991435 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:36.346987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:36.354758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9a79c87f-f98e-4f03-a377-3d41701f4df5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1681 microversion: 2.1 time: 0.377124 May 12 19:02:36.355541 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 214/414] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:35 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1681 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:36.805485 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-294d5b7a-83ac-477f-8786-1a68e6c87839 req-1fdcd2c5-9a75-46a7-967b-a10b699a203b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b7344e-55ce-4f61-9c68-6473e53a5d9f", "name": "network-vif-deleted", "tag": "9448ad28-f42c-4629-9127-6323c2e65835"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:36.814262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-294d5b7a-83ac-477f-8786-1a68e6c87839 req-1fdcd2c5-9a75-46a7-967b-a10b699a203b service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:36.814838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-294d5b7a-83ac-477f-8786-1a68e6c87839 req-1fdcd2c5-9a75-46a7-967b-a10b699a203b service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:36.826234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-294d5b7a-83ac-477f-8786-1a68e6c87839 req-1fdcd2c5-9a75-46a7-967b-a10b699a203b service nova] Creating event network-vif-deleted:9448ad28-f42c-4629-9127-6323c2e65835 for instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f on hv-cinder-79575 May 12 19:02:36.832150 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-294d5b7a-83ac-477f-8786-1a68e6c87839 req-1fdcd2c5-9a75-46a7-967b-a10b699a203b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030133 May 12 19:02:36.836249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 201/415] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:37.373432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:37.374290 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:37.381329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:37.382005 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:37.383010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:37.383455 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:37.415336 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:37.415964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:37.416523 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lazy-loading 'fault' on Instance uuid 29b7344e-55ce-4f61-9c68-6473e53a5d9f {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:02:37.458961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:37.466426 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2e0366fb-440b-40ab-af33-d3b3821b7c72 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 200 len: 1332 microversion: 2.1 time: 0.096992 May 12 19:02:37.467114 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 215/416] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:37 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:38.485402 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:38.486134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:38.492688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:38.493143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:38.493953 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:38.494376 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:38.507236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f HTTP/1.1 May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:02:38.508814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:02:38.510323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '29b7344e-55ce-4f61-9c68-6473e53a5d9f'} May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:02:38.511099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:02:38.512341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:38.513350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:02:38.513350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c8f6b5e1-9c07-4dd3-96ff-574c4ddc3941 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 404 len: 111 microversion: 2.1 time: 0.030209 May 12 19:02:38.513350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 202/417] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:38 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:02:38.518807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b9bdb23b-675f-4242-a7d3-56cbadce3d81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '.version_select at 0x7f38c25330d0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:38.538362 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b9bdb23b-675f-4242-a7d3-56cbadce3d81 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115536028" status: 202 len: 0 microversion: 2.1 time: 0.023188 May 12 19:02:38.538931 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 216/418] 10.222.0.48 () {58 vars in 1220 bytes} [Thu May 12 19:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115536028 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 19:02:39.233386 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:39.233902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:39.240304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:39.240745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:39.241489 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:39.241946 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:39.364347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lazy-loading 'services' on Instance uuid 64bcf7c1-c1cd-4149-af79-39ad90968742 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:02:39.475928 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4d16cc36-14cb-47f0-a645-e77bb2491d6b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments/0b01918f-2d79-41d9-bff6-29c8332d780c" status: 202 len: 0 microversion: 2.1 time: 0.246190 May 12 19:02:39.476520 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 203/419] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:02:39 2022] DELETE /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments/0b01918f-2d79-41d9-bff6-29c8332d780c => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:02:39.484968 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bff7db01-287f-4ce6-9f84-54e135f7499d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:39.485921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bff7db01-287f-4ce6-9f84-54e135f7499d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:39.492518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bff7db01-287f-4ce6-9f84-54e135f7499d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:39.493019 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bff7db01-287f-4ce6-9f84-54e135f7499d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:39.493970 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bff7db01-287f-4ce6-9f84-54e135f7499d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:39.494414 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bff7db01-287f-4ce6-9f84-54e135f7499d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:39.523626 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bff7db01-287f-4ce6-9f84-54e135f7499d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 May 12 19:02:39.524256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 217/420] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:02:39 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:40.536240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b490f12a-6454-467d-978b-34cf42a55faa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:40.537570 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b490f12a-6454-467d-978b-34cf42a55faa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:40.544386 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b490f12a-6454-467d-978b-34cf42a55faa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:40.544841 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b490f12a-6454-467d-978b-34cf42a55faa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:40.545648 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b490f12a-6454-467d-978b-34cf42a55faa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:40.546093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b490f12a-6454-467d-978b-34cf42a55faa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:40.575103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b490f12a-6454-467d-978b-34cf42a55faa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043606 May 12 19:02:40.575660 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 204/421] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:02:40 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:02:40.630333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:40.630831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:40.637068 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:40.637548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:40.638367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:40.638806 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:40.663311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:02:40.737157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8ed5805b-7731-42f0-8fab-b8208a51999e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 204 len: 0 microversion: 2.1 time: 0.110286 May 12 19:02:40.737885 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 218/422] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:02:40 2022] DELETE /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:02:40.746611 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:40.747229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:40.753052 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:40.753499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:40.754290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:40.754723 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:40.882774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:40.890130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-75e0e38a-c0fb-4e08-b365-4897b4f6dde4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1681 microversion: 2.1 time: 0.147324 May 12 19:02:40.891250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 205/423] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:40 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:41.908588 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:41.909289 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:41.915860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:41.916312 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:41.917078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:41.917515 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:42.048775 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:42.056039 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f4835e10-0bef-4fef-aa7a-6344d9184e96 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1681 microversion: 2.1 time: 0.152270 May 12 19:02:42.056602 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 219/424] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:41 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:43.073120 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:43.073725 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:43.080989 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:43.081437 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:43.082241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:43.082669 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:43.282781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:43.290738 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b226a9ae-fe01-4e14-90ee-3ee4ee899b93 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 200 len: 1681 microversion: 2.1 time: 0.221469 May 12 19:02:43.291297 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 206/425] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:43 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:43.650234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-af03c540-6dde-4d9a-b9ba-9418a9bc0bc5 req-63046a06-d0d8-4c4f-9da6-cbf02dc2af47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64bcf7c1-c1cd-4149-af79-39ad90968742", "name": "network-vif-deleted", "tag": "1b6193bd-0c92-47cd-8e4c-4291685e61ee"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:43.659058 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-af03c540-6dde-4d9a-b9ba-9418a9bc0bc5 req-63046a06-d0d8-4c4f-9da6-cbf02dc2af47 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:43.659503 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-af03c540-6dde-4d9a-b9ba-9418a9bc0bc5 req-63046a06-d0d8-4c4f-9da6-cbf02dc2af47 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:43.671415 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-af03c540-6dde-4d9a-b9ba-9418a9bc0bc5 req-63046a06-d0d8-4c4f-9da6-cbf02dc2af47 service nova] Creating event network-vif-deleted:1b6193bd-0c92-47cd-8e4c-4291685e61ee for instance 64bcf7c1-c1cd-4149-af79-39ad90968742 on hv-cinder-79575 May 12 19:02:43.676844 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-af03c540-6dde-4d9a-b9ba-9418a9bc0bc5 req-63046a06-d0d8-4c4f-9da6-cbf02dc2af47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030321 May 12 19:02:43.680522 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 220/426] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:44.308516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:44.309812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:44.316987 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:44.317438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:44.318271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:44.318714 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:44.332829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 HTTP/1.1 May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:02:44.334497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:02:44.336118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '64bcf7c1-c1cd-4149-af79-39ad90968742'} May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:02:44.337015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:02:44.338496 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:02:44.339879 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:02:44.339879 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1e1bc8e9-772b-404b-865f-041a34a73589 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 404 len: 111 microversion: 2.1 time: 0.031454 May 12 19:02:44.340259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 207/427] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:44 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:02:44.345954 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5d5de2a3-2021-4cdd-882b-099a389a1c84 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '.version_select at 0x7f38c25c6c10>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:44.363570 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5d5de2a3-2021-4cdd-882b-099a389a1c84 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991571828" status: 202 len: 0 microversion: 2.1 time: 0.022301 May 12 19:02:44.364149 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 221/428] 10.222.0.48 () {58 vars in 1217 bytes} [Thu May 12 19:02:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991571828 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:02:44.988806 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-85e917ef-50c2-4d6b-884c-6df738ebf8ae tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: .version_select at 0x7f38c24cb040>, body: {"keypair": {"name": "tempest-keypair-1461001543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiJjxO51KqxZXuxCQx5tJRAgosfLsSlwlGnYt9AYJJ+2v3jgKuw8WtFN3aHD7O4J0kpywRXUlkf0c4lXuBh8CXuNfRqKRYI6fBxQnFfAG154lEVwdgYBV9lWH/EyEMidQ=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:45.002161 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-85e917ef-50c2-4d6b-884c-6df738ebf8ae tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:02:45.005843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-85e917ef-50c2-4d6b-884c-6df738ebf8ae tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:02:45.026664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-85e917ef-50c2-4d6b-884c-6df738ebf8ae tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.041782 May 12 19:02:45.027227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 208/429] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:02:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:46.274594 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1356195684", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b"}], "security_groups": [{"name": "tempest-securitygroup--77241044"}], "key_name": "tempest-keypair-1461001543", "user_data": "}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:46.376322 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] validate_networks() for [('5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:02:46.729148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:02:46.729600 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:02:46.730081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:02:46.730500 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:02:46.730915 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:02:46.739378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:46.739831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:46.740634 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:46.741085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:46.757300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:02:46.761102 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:02:46.772231 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:02:46.774581 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:02:46.820154 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f9f1501c-33fa-4532-9809-a4e2dc9dabf6 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.550324 May 12 19:02:46.820804 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 222/430] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:02:46 2022] POST /compute/v2.1/servers => generated 400 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:02:46.831735 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-cd31cd36-f990-4d72-a7a2-40e7dab1cfb8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:46.832352 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-cd31cd36-f990-4d72-a7a2-40e7dab1cfb8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:46.889917 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cd31cd36-f990-4d72-a7a2-40e7dab1cfb8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:46.897734 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-cd31cd36-f990-4d72-a7a2-40e7dab1cfb8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1242 microversion: 2.1 time: 0.070811 May 12 19:02:46.901575 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 209/431] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:46 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:47.915920 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:47.916636 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:47.924112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:47.924682 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:47.925713 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:47.926977 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:48.000211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:48.007641 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b6fa6f99-e85b-49b3-ab7d-d3c0423b3768 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1300 microversion: 2.1 time: 0.096667 May 12 19:02:48.008208 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 223/432] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:47 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:49.024013 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:49.024752 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:49.031174 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:49.031707 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:49.032568 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:49.033072 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:49.261904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:49.268970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c78018c1-c1b3-4da0-a9e7-62ee04421681 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.248740 May 12 19:02:49.269549 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 210/433] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:49 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:49.672428 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-afc53b96-2c1d-4263-8b96-60d70ea0a30b req-e15e26a6-b349-485d-bb62-5a097456c4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87951282-3c6e-4899-9775-022278e4bfa8", "tag": "1cfe36b5-8273-4971-b681-1637c5aa6837"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:49.681814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-afc53b96-2c1d-4263-8b96-60d70ea0a30b req-e15e26a6-b349-485d-bb62-5a097456c4c8 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:49.682611 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-afc53b96-2c1d-4263-8b96-60d70ea0a30b req-e15e26a6-b349-485d-bb62-5a097456c4c8 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:49.695491 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-afc53b96-2c1d-4263-8b96-60d70ea0a30b req-e15e26a6-b349-485d-bb62-5a097456c4c8 service nova] Creating event network-changed:1cfe36b5-8273-4971-b681-1637c5aa6837 for instance 87951282-3c6e-4899-9775-022278e4bfa8 on hv-cinder-79575 May 12 19:02:49.700327 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-afc53b96-2c1d-4263-8b96-60d70ea0a30b req-e15e26a6-b349-485d-bb62-5a097456c4c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032336 May 12 19:02:49.701078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 224/434] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:50.286363 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:50.286979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:50.293209 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:50.293694 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:50.294864 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:50.295307 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:50.422158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:50.429289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-19da3618-69ef-4a88-98e5-fb32baff7cd4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.146954 May 12 19:02:50.429862 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 211/435] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:50 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:51.447196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:51.447945 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:51.454515 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:51.454964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:51.455734 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:51.456166 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:51.661487 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:51.668708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-24f3013a-c00f-4ecf-9993-73b6f4099cf5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.226074 May 12 19:02:51.669490 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 225/436] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:51 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:52.685077 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:52.685724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:52.692105 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:52.692556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:52.693422 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:52.693884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:52.821128 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:52.828296 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b1b5b57f-9bfc-4d20-9372-59f305a49e34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.146917 May 12 19:02:52.828851 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 212/437] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:52 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:53.844207 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:53.844741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:53.851001 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:53.851449 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:53.852204 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:53.852637 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:53.981085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:53.988881 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-975a53e1-efd1-4df1-bd3d-2ed7e6dc5ace tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.148592 May 12 19:02:53.989447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 226/438] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:53 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:55.005504 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:55.006160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:55.012439 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:55.012877 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:55.013736 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:55.014168 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:55.141547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:55.148645 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e51724cd-f7d3-4b48-a3b0-c42d465b4980 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.146951 May 12 19:02:55.149194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 213/439] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:55 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:56.051857 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-b3ac0811-5d3d-42fc-950c-ffc753be95ac req-594792e7-7f87-4aac-b1f7-7f4e49fb2d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87951282-3c6e-4899-9775-022278e4bfa8", "name": "network-vif-plugged", "status": "completed", "tag": "1cfe36b5-8273-4971-b681-1637c5aa6837"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:56.060689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b3ac0811-5d3d-42fc-950c-ffc753be95ac req-594792e7-7f87-4aac-b1f7-7f4e49fb2d20 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:56.061149 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b3ac0811-5d3d-42fc-950c-ffc753be95ac req-594792e7-7f87-4aac-b1f7-7f4e49fb2d20 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:56.073124 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-b3ac0811-5d3d-42fc-950c-ffc753be95ac req-594792e7-7f87-4aac-b1f7-7f4e49fb2d20 service nova] Creating event network-vif-plugged:1cfe36b5-8273-4971-b681-1637c5aa6837 for instance 87951282-3c6e-4899-9775-022278e4bfa8 on hv-cinder-79575 May 12 19:02:56.078665 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-b3ac0811-5d3d-42fc-950c-ffc753be95ac req-594792e7-7f87-4aac-b1f7-7f4e49fb2d20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029850 May 12 19:02:56.079260 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 227/440] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:56.164490 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:56.165118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:56.171243 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:56.171711 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:56.172478 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:56.172907 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:56.346581 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:56.353905 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1fa2f164-f8d9-4c0a-aad3-325f79027bad tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.193559 May 12 19:02:56.354608 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 214/441] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:56 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:57.370833 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:57.371542 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:57.377686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:57.378140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:57.378960 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:57.379358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:57.504713 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:57.512074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f73538c3-a425-4882-91a0-97eb4d1d1e8b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1366 microversion: 2.1 time: 0.145839 May 12 19:02:57.512645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 228/442] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:57 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:58.529160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:58.529790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:58.536843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:58.537288 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:58.538070 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:58.538500 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:58.666258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:02:58.674116 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c9cc93c4-ee3a-4fc2-8166-f80eb2ef441a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1555 microversion: 2.1 time: 0.148744 May 12 19:02:58.674691 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 215/443] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:02:58 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:02:58.689904 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-df7b8c5a-4341-48c1-b215-89ffe465dd23 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:02:58.690392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-df7b8c5a-4341-48c1-b215-89ffe465dd23 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:02:58.696552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df7b8c5a-4341-48c1-b215-89ffe465dd23 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:58.697026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df7b8c5a-4341-48c1-b215-89ffe465dd23 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:58.697821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df7b8c5a-4341-48c1-b215-89ffe465dd23 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:58.698262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-df7b8c5a-4341-48c1-b215-89ffe465dd23 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:58.771696 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-df7b8c5a-4341-48c1-b215-89ffe465dd23 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085492 May 12 19:02:58.772292 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 229/444] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:02:58 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:02:59.714711 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-aee867c0-5c60-432e-b866-09d6bb23b35c req-53c4c2ec-3166-497c-a1db-b15e61b47bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87951282-3c6e-4899-9775-022278e4bfa8", "tag": "1cfe36b5-8273-4971-b681-1637c5aa6837"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:02:59.723305 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-aee867c0-5c60-432e-b866-09d6bb23b35c req-53c4c2ec-3166-497c-a1db-b15e61b47bf0 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:02:59.723776 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-aee867c0-5c60-432e-b866-09d6bb23b35c req-53c4c2ec-3166-497c-a1db-b15e61b47bf0 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:02:59.735367 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-aee867c0-5c60-432e-b866-09d6bb23b35c req-53c4c2ec-3166-497c-a1db-b15e61b47bf0 service nova] Creating event network-changed:1cfe36b5-8273-4971-b681-1637c5aa6837 for instance 87951282-3c6e-4899-9775-022278e4bfa8 on hv-cinder-79575 May 12 19:02:59.740377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-aee867c0-5c60-432e-b866-09d6bb23b35c req-53c4c2ec-3166-497c-a1db-b15e61b47bf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029346 May 12 19:02:59.740965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 216/445] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:00.425094 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:00.425660 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:00.431381 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:00.431830 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:00.432596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:00.433033 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:00.556398 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lazy-loading 'services' on Instance uuid 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:03:00.668255 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-db1467c7-3594-4680-ba82-1145a6859bd2 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-volume_attachments/48407bbf-ba8f-433d-a277-12bc2cb4945f" status: 202 len: 0 microversion: 2.1 time: 0.247573 May 12 19:03:00.669276 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 230/446] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:03:00 2022] DELETE /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-volume_attachments/48407bbf-ba8f-433d-a277-12bc2cb4945f => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:03:01.783015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2b9dd667-58f0-4b89-9d3d-df3a56496b4a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:01.789359 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2b9dd667-58f0-4b89-9d3d-df3a56496b4a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:01.789838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2b9dd667-58f0-4b89-9d3d-df3a56496b4a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:01.811374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2b9dd667-58f0-4b89-9d3d-df3a56496b4a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Going to try to stop instance {{(pid=117101) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 19:03:01.852229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2b9dd667-58f0-4b89-9d3d-df3a56496b4a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action" status: 202 len: 0 microversion: 2.1 time: 0.074184 May 12 19:03:01.852743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 217/447] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:03:01 2022] POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:03:01.862339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:01.863184 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:01.869852 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:01.870303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:01.871197 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:01.871642 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:01.998541 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:02.005783 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-34b356fd-5231-408d-a130-fea7d5499a43 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.148729 May 12 19:03:02.006352 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 231/448] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:01 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:03.024021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:03.024650 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:03.030784 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:03.031233 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:03.032622 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:03.033055 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:03.164425 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:03.171857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-687e5fb8-5bc7-4d98-a66b-e59dcf47007a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.152545 May 12 19:03:03.172413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 218/449] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:03 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:04.189338 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:04.189974 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:04.196243 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:04.196690 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:04.197440 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:04.197910 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:04.325744 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:04.332962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b2f0df7a-a124-4c2a-948e-3b1bf937f857 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.148100 May 12 19:03:04.333546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 232/450] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:04 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:04.522629 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-170b3393-3745-4103-a97c-842ab41e7173 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5f40993-b822-4f4f-a641-60a452a1df94"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:04.523679 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-170b3393-3745-4103-a97c-842ab41e7173 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:04.529905 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-170b3393-3745-4103-a97c-842ab41e7173 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:04.530347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-170b3393-3745-4103-a97c-842ab41e7173 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:04.531101 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-170b3393-3745-4103-a97c-842ab41e7173 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:04.532034 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-170b3393-3745-4103-a97c-842ab41e7173 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:04.794272 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-170b3393-3745-4103-a97c-842ab41e7173 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275294 May 12 19:03:04.794794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 219/451] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:03:04 2022] POST /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:05.350461 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:05.351014 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:05.357271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:05.357772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:05.358539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:05.358976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:05.491510 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:05.499524 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ec68ef87-4072-4a0d-ab21-63d8c3d4a6bf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.153042 May 12 19:03:05.500070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 233/452] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:05 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:06.517381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:06.518117 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:06.524302 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:06.524757 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:06.525554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:06.525989 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:06.654130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:06.662415 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f2c2a356-7708-4e72-a8c2-af33341619a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.149490 May 12 19:03:06.663219 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 220/453] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:06 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:07.687655 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:07.688271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:07.694736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:07.695200 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:07.695974 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:07.696417 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:07.824547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:07.831899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-12d6001f-26a3-4e38-9298-5fbe52891cd5 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.148162 May 12 19:03:07.832470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 234/454] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:07 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:08.848126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:08.848734 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:08.855031 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:08.855477 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:08.856240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:08.856683 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:08.986833 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:08.994083 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bf8992f7-29c4-42ca-93ac-10c55bd2b06d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.149843 May 12 19:03:08.994637 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 221/455] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:08 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:09.630261 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2a6c4aa3-dcf5-497f-ba3b-ab19aa225188 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:09.630871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2a6c4aa3-dcf5-497f-ba3b-ab19aa225188 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:09.637016 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a6c4aa3-dcf5-497f-ba3b-ab19aa225188 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:09.637460 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a6c4aa3-dcf5-497f-ba3b-ab19aa225188 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:09.638341 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a6c4aa3-dcf5-497f-ba3b-ab19aa225188 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:09.638782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2a6c4aa3-dcf5-497f-ba3b-ab19aa225188 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:09.667972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2a6c4aa3-dcf5-497f-ba3b-ab19aa225188 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments/b3afe106-49c8-4331-84d7-fca0dacf62f5" status: 200 len: 194 microversion: 2.20 time: 0.041636 May 12 19:03:09.668634 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 235/456] 10.222.0.48 () {60 vars in 1453 bytes} [Thu May 12 19:03:09 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments/b3afe106-49c8-4331-84d7-fca0dacf62f5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:03:09.730280 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:09.730775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:09.736956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:09.737406 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:09.738213 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:09.738646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:09.815492 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lazy-loading 'services' on Instance uuid f3fae6df-666d-4354-9089-87b51631cb48 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:03:09.886519 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6ff62ddd-5963-474e-8452-dc42a231a91d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments/b3afe106-49c8-4331-84d7-fca0dacf62f5" status: 202 len: 0 microversion: 2.20 time: 0.159604 May 12 19:03:09.887185 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 222/457] 10.222.0.48 () {60 vars in 1456 bytes} [Thu May 12 19:03:09 2022] DELETE /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments/b3afe106-49c8-4331-84d7-fca0dacf62f5 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 19:03:09.896165 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ae01154e-45ad-450c-958e-0025c637eab9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:09.897160 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ae01154e-45ad-450c-958e-0025c637eab9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:09.904004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae01154e-45ad-450c-958e-0025c637eab9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:09.904474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae01154e-45ad-450c-958e-0025c637eab9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:09.905259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae01154e-45ad-450c-958e-0025c637eab9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:09.905742 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ae01154e-45ad-450c-958e-0025c637eab9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:09.934552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ae01154e-45ad-450c-958e-0025c637eab9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042411 May 12 19:03:09.935121 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 236/458] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 12 19:03:09 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:03:10.011877 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:10.012578 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:10.019303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:10.019767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:10.020546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:10.020984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:10.146865 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:10.154133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-24796104-26e7-4567-8982-ff33ee34f4b1 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.146432 May 12 19:03:10.154690 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 223/459] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:10 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:10.946898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4d5a3c52-a41c-4bf4-8a4d-11248ef88d4c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:10.947808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4d5a3c52-a41c-4bf4-8a4d-11248ef88d4c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:10.954140 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c52-a41c-4bf4-8a4d-11248ef88d4c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:10.954585 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c52-a41c-4bf4-8a4d-11248ef88d4c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:10.955340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c52-a41c-4bf4-8a4d-11248ef88d4c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:10.955769 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4d5a3c52-a41c-4bf4-8a4d-11248ef88d4c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:10.983033 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4d5a3c52-a41c-4bf4-8a4d-11248ef88d4c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040089 May 12 19:03:10.983571 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 237/460] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 12 19:03:10 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:03:11.171132 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:11.172231 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:11.178458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:11.178904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:11.179672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:11.180100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:11.307197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:11.314913 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6b8b474e-545a-467d-ab9d-de6d94dcf8f7 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1677 microversion: 2.1 time: 0.147545 May 12 19:03:11.315512 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 224/461] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:11 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:11.994380 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9687eee4-38e4-4036-b04f-815bb7c91e37 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:11.995305 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9687eee4-38e4-4036-b04f-815bb7c91e37 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:12.002326 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9687eee4-38e4-4036-b04f-815bb7c91e37 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.002782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9687eee4-38e4-4036-b04f-815bb7c91e37 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.003562 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9687eee4-38e4-4036-b04f-815bb7c91e37 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.004004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9687eee4-38e4-4036-b04f-815bb7c91e37 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.032765 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9687eee4-38e4-4036-b04f-815bb7c91e37 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042355 May 12 19:03:12.033320 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 238/462] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 12 19:03:11 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:03:12.270542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:12.272254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:12.279093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.279539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.280571 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.281775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.305560 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lazy-loading 'flavor' on Instance uuid 665565c6-dd25-45be-b6a5-db7fddff10cf {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:03:12.331744 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:12.332382 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:12.338523 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.338964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.339724 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.340157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.426331 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6b0a0ba5-33ca-4116-9c38-ef7355723282 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/action" status: 200 len: 32 microversion: 2.1 time: 0.162779 May 12 19:03:12.430956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 225/463] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:03:12 2022] POST /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 19:03:12.445814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:12.446810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:12.453469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.454025 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.454842 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.455284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.479074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:12.487929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-54b48461-16d0-44d6-ac8c-21572abc08b6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1654 microversion: 2.1 time: 0.160017 May 12 19:03:12.488496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 239/464] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:12 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:12.505360 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1cfd892d-f74a-4c68-9459-6b06090abbcb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:12.511176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1cfd892d-f74a-4c68-9459-6b06090abbcb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.511623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1cfd892d-f74a-4c68-9459-6b06090abbcb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.535657 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1cfd892d-f74a-4c68-9459-6b06090abbcb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Going to try to start instance {{(pid=117102) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 19:03:12.580132 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1cfd892d-f74a-4c68-9459-6b06090abbcb tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action" status: 202 len: 0 microversion: 2.1 time: 0.078703 May 12 19:03:12.580737 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 240/465] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:03:12 2022] POST /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:03:12.590166 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:12.590871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:12.598262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.598740 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:12.599779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:12.600202 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:13.079482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:13.087401 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c4e1693a-e5ef-4e7c-aa9a-2b536a94fe55 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.652587 May 12 19:03:13.087981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 226/466] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:12 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:13.101999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-093be2f9-339f-4f3e-ae30-66feeb10079a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:13.102939 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-093be2f9-339f-4f3e-ae30-66feeb10079a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:13.108630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-093be2f9-339f-4f3e-ae30-66feeb10079a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:13.109107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-093be2f9-339f-4f3e-ae30-66feeb10079a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:13.109914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-093be2f9-339f-4f3e-ae30-66feeb10079a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:13.110357 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-093be2f9-339f-4f3e-ae30-66feeb10079a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:13.111569 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:13.120239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-31e9a74f-76ce-4141-9562-81f8bca1b14a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1663 microversion: 2.1 time: 0.534190 May 12 19:03:13.122155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 241/467] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:12 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1663 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:13.146727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-093be2f9-339f-4f3e-ae30-66feeb10079a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048400 May 12 19:03:13.147289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 227/468] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 12 19:03:13 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:13.206200 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:13.206693 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:13.212896 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:13.213343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:13.214256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:13.214685 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:13.239439 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:03:13.316378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-45fc043b-4e89-4d72-bfc9-28c48ec9c1e1 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 204 len: 0 microversion: 2.20 time: 0.114923 May 12 19:03:13.317070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 242/469] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 12 19:03:13 2022] DELETE /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 19:03:13.325424 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:13.326051 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:13.332780 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:13.333236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:13.334019 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:13.334452 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:13.462767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:13.471784 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:13.473344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:13.474521 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f073ccc7-de02-4f9f-a08c-6bd3c3346e2c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.153115 May 12 19:03:13.475080 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 228/470] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:13 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:14.104674 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:14.105379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:14.112117 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:14.112721 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:14.113323 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:14.113795 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:14.138772 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:14.139380 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:14.145262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:14.145775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:14.146557 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:14.147015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:14.294711 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:14.303163 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4a26d699-4c22-425c-8ac5-e53c9ef89e5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.202738 May 12 19:03:14.303847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 243/471] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:14 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:14.319927 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:14.327070 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9c0b5bf2-b4e5-47af-88df-3ab7fc368d1c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1663 microversion: 2.1 time: 0.192119 May 12 19:03:14.327651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 229/472] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:14 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1663 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:14.493139 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:14.493790 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:14.500046 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:14.500495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:14.501377 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:14.501966 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:14.629792 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:14.637637 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:14.639117 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:14.640789 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f7d8dc4b-1eb2-4928-a604-2c44ac3fa6bf tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.151039 May 12 19:03:14.641369 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 244/473] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:14 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:15.320401 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:15.321124 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:15.327403 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:15.328037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:15.329203 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:15.329665 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:15.344448 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:15.345097 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:15.351902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:15.352281 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:15.353292 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:15.353842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:15.639709 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:15.647530 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-28bf2442-8c14-4617-8d4c-c2cc1e824a88 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.331063 May 12 19:03:15.648446 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 230/474] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:15 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:15.650931 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:15.659454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:15.660066 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:15.661450 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2fdf736d-d1b6-4800-88b4-beb9be53803f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1663 microversion: 2.1 time: 0.321060 May 12 19:03:15.662155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 245/475] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:15 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1663 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:15.666268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:15.666721 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:15.667494 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:15.667928 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:15.890322 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:15.898028 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:15.899525 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:15.900692 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-15c38641-3325-4db1-a497-b8e70abfc045 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 200 len: 1725 microversion: 2.20 time: 0.244995 May 12 19:03:15.901247 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 231/476] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:15 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:16.282874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-9c0cf3c3-49cc-4c5f-891b-939100fc8ace req-0edcffe2-3ec4-4957-ac82-69c08797b2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fae6df-666d-4354-9089-87b51631cb48", "name": "network-vif-deleted", "tag": "1abe14a4-11ef-449b-a24c-786cad5c7d21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:16.290895 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-9c0cf3c3-49cc-4c5f-891b-939100fc8ace req-0edcffe2-3ec4-4957-ac82-69c08797b2f5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:16.291332 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-9c0cf3c3-49cc-4c5f-891b-939100fc8ace req-0edcffe2-3ec4-4957-ac82-69c08797b2f5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:16.301806 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-9c0cf3c3-49cc-4c5f-891b-939100fc8ace req-0edcffe2-3ec4-4957-ac82-69c08797b2f5 service nova] Creating event network-vif-deleted:1abe14a4-11ef-449b-a24c-786cad5c7d21 for instance f3fae6df-666d-4354-9089-87b51631cb48 on hv-cinder-79575 May 12 19:03:16.306849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-9c0cf3c3-49cc-4c5f-891b-939100fc8ace req-0edcffe2-3ec4-4957-ac82-69c08797b2f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028184 May 12 19:03:16.307441 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 246/477] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:16.665172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:16.666410 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:16.673662 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:16.674112 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:16.674888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:16.675319 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:16.680359 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:16.681620 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:16.689206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:16.689694 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:16.690480 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:16.690923 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:16.876783 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:16.883580 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:16.884972 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d83f1c93-fb69-424b-b477-d3ff66ec6934 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.224682 May 12 19:03:16.892051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1f83148e-6fe5-414a-a514-9e3abea37810 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1667 microversion: 2.1 time: 0.216696 May 12 19:03:16.896586 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 232/478] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:16 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:16.897083 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 247/479] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:16 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1667 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:16.919680 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:16.920249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:16.926192 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:16.926639 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:16.927402 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:16.927835 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:16.941043 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] HTTP exception thrown: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Request method failure captured: May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 HTTP/1.1 May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkfQ-Ce5_w2D9E7b9S_rmAAUF8HxjZHalhYvaft_diBSfSvyGUPByEVlsGxtmsk5c6Gq4W2BL91rcbdCs48ogL3XsC0LYfb9jndncQPZ1QZkf7fgFJdvziWmnPTMxuXYRgCMWjEVQTJQCw4JaosMcrkVpFM0Nii6Ge-16k-rLoJ-r8 May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Openstack-Nova-Api-Version: 2.20 May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:03:16.942764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a8b3b5b2c48416c8c6b99b27cfa3aeb", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 803b29a8c5e34ef0993913c0b08ccfd1 May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:03:16.944250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'f3fae6df-666d-4354-9089-87b51631cb48'} May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:03:16.945100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:03:16.946603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:16.947944 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Returning 404 to user: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:03:16.947944 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0b2727b3-5eb8-4e33-ba41-0706b7186ab5 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 404 len: 111 microversion: 2.20 time: 0.028473 May 12 19:03:16.947944 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 233/480] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:16 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 19:03:16.953763 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-24072a6c-5796-42fc-a46b-3d825f3fde5a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '.version_select at 0x7f38c24188b0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:16.972184 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-24072a6c-5796-42fc-a46b-3d825f3fde5a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982289218" status: 204 len: 0 microversion: 2.20 time: 0.022792 May 12 19:03:16.972844 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 248/481] 10.222.0.48 () {60 vars in 1258 bytes} [Thu May 12 19:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982289218 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 19:03:17.630374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dea852ff-a68b-47f5-8728-3ca8710cfe19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'create', calling method: .version_select at 0x7f38c23d44c0>, body: {"keypair": {"name": "tempest-keypair-239890967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn8TME4rOAWRz/Itl9xGyhPG6w67zRXvV6vwF2oQoqnF8u2HMyHv3If2P+PqN7DnfWqh8NtCGYdDRTZnZlYdrFb+JRcb3XMX5PCqe7qBoAANs8DDMWaiZn92AatwSCH/w=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:17.646904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-dea852ff-a68b-47f5-8728-3ca8710cfe19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:03:17.650937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-dea852ff-a68b-47f5-8728-3ca8710cfe19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for user 803b29a8c5e34ef0993913c0b08ccfd1 and project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:03:17.674581 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dea852ff-a68b-47f5-8728-3ca8710cfe19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048004 May 12 19:03:17.675260 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 234/482] 10.222.0.48 () {62 vars in 1199 bytes} [Thu May 12 19:03:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 19:03:17.903760 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:17.904372 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:17.910855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:17.911300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:17.912072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:17.912703 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:18.052060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:18.060316 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-43f358b5-7fc8-4f2c-b007-73cde8e0badb tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.160913 May 12 19:03:18.061313 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 249/483] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:17 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:18.933223 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1524192150", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5a4fc0e-0042-4201-aa54-6b150376479a"}], "security_groups": [{"name": "tempest-securitygroup--1348569908"}], "key_name": "tempest-keypair-239890967", "user_data": "}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:19.031157 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] validate_networks() for [('a5a4fc0e-0042-4201-aa54-6b150376479a', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:03:19.077551 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:19.078205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:19.084397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:19.084846 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:19.085651 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:19.086093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:19.276592 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:19.285393 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e99d5770-0f1b-4a21-8f21-e551eaac3b14 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.211324 May 12 19:03:19.285934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 250/484] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:19 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:19.688165 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:03:19.688586 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:03:19.689051 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:03:19.689450 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:03:19.689877 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:03:19.698189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:19.698630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:19.699417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:19.699845 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:19.716876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:03:19.721335 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Getting quotas for user 803b29a8c5e34ef0993913c0b08ccfd1 and project 2a8b3b5b2c48416c8c6b99b27cfa3aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:03:19.731793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:03:19.734059 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:03:19.781629 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-78e1c891-0131-418c-8383-e56b9933f651 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.853102 May 12 19:03:19.782350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 235/485] 10.222.0.48 () {62 vars in 1187 bytes} [Thu May 12 19:03:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 19:03:19.792420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ae595774-0f34-46ba-9d8b-53fdffd71003 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:19.793026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ae595774-0f34-46ba-9d8b-53fdffd71003 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:19.848256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ae595774-0f34-46ba-9d8b-53fdffd71003 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:19.855271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ae595774-0f34-46ba-9d8b-53fdffd71003 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:19.856780 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ae595774-0f34-46ba-9d8b-53fdffd71003 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:19.857886 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ae595774-0f34-46ba-9d8b-53fdffd71003 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1281 microversion: 2.20 time: 0.069284 May 12 19:03:19.858438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 251/486] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:19 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:03:20.303610 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:20.304213 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:20.310914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:20.311371 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:20.312147 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:20.312589 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:20.437950 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:20.445724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8c41a197-c6a7-4d5d-9ffe-ef55aa364de0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.146548 May 12 19:03:20.446283 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 236/487] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:20 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:20.875318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:20.876673 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:20.883546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:20.883992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:20.884775 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:20.885212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:20.956700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:20.964374 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:20.965883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:20.966978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9e9566a6-dae1-4d7d-b3c7-16a353823668 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1351 microversion: 2.20 time: 0.095612 May 12 19:03:20.967537 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 252/488] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:20 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:03:21.463914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:21.464519 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:21.470846 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:21.471301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:21.472078 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:21.472520 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:21.686024 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:21.696539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-adb94c44-bd0f-4454-9d19-74ecfe2d69ed tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.237364 May 12 19:03:21.697439 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 237/489] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:21 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:21.985352 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:21.986760 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:21.993035 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:21.993511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:21.994324 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:21.994757 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:22.208407 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:22.217049 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:22.219252 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:22.220444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ac8eb96b-a047-4296-b081-32f837d34e7d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1407 microversion: 2.20 time: 0.239006 May 12 19:03:22.221227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 253/490] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:21 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:22.403926 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-55ad393e-ad9a-4f20-b0f4-2bffa68b938f req-a6d92b95-3c46-43f0-8c65-e375b314c9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651ff207-805c-42db-9da8-6e493ecdd78e", "tag": "d6ee4e3b-c3f4-4c30-877e-37f58454c827"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:22.412964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-55ad393e-ad9a-4f20-b0f4-2bffa68b938f req-a6d92b95-3c46-43f0-8c65-e375b314c9a7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:22.413399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-55ad393e-ad9a-4f20-b0f4-2bffa68b938f req-a6d92b95-3c46-43f0-8c65-e375b314c9a7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:22.429876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-55ad393e-ad9a-4f20-b0f4-2bffa68b938f req-a6d92b95-3c46-43f0-8c65-e375b314c9a7 service nova] Creating event network-changed:d6ee4e3b-c3f4-4c30-877e-37f58454c827 for instance 651ff207-805c-42db-9da8-6e493ecdd78e on hv-cinder-79575 May 12 19:03:22.435071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-55ad393e-ad9a-4f20-b0f4-2bffa68b938f req-a6d92b95-3c46-43f0-8c65-e375b314c9a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040296 May 12 19:03:22.435684 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 238/491] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:22.716485 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:22.717105 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:22.723121 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:22.723582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:22.724359 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:22.724801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:22.918817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:22.927082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8366fe65-f1e3-4085-8a88-9f2748e918f0 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.214970 May 12 19:03:22.927651 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 254/492] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:22 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:23.240424 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:23.241140 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:23.247268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:23.247712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:23.248472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:23.248902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:23.373238 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:23.380983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:23.382430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:23.383528 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1c9a784f-7af4-45c3-9735-f154751dc001 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1407 microversion: 2.20 time: 0.147795 May 12 19:03:23.384083 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 239/493] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:23 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:23.944135 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:23.944742 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:23.951022 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:23.951466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:23.952731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:23.953161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:24.082854 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:24.090644 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4528c61c-73ff-4016-80a3-75fdd19b4fbf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.150380 May 12 19:03:24.091217 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 255/494] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:23 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:24.400919 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:24.401553 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:24.407754 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:24.408226 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:24.408988 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:24.409416 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:24.598535 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:24.606331 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:24.607829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:24.609454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8b5402bc-a738-44a7-ac31-46da74c375a8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1407 microversion: 2.20 time: 0.212427 May 12 19:03:24.610072 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 240/495] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:24 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:25.107742 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:25.108274 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:25.114554 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:25.115012 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:25.115791 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:25.116230 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:25.239649 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:25.247346 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-89fbb408-f558-49e2-8a4e-8e2395599216 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.143529 May 12 19:03:25.247918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 256/496] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:25 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:25.627068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:25.627675 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:25.633923 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:25.634372 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:25.635124 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:25.635557 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:25.768435 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:25.775994 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:25.777462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:25.778570 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1edf28ea-342e-4b89-a509-4fe069c0fbc4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1407 microversion: 2.20 time: 0.155447 May 12 19:03:25.779129 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 241/497] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:25 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:26.265033 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:26.265632 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:26.271979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:26.272436 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:26.273205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:26.273682 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:26.396133 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:26.403978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bf4edf84-6922-4e9b-aff4-3a7d7d31d870 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.142817 May 12 19:03:26.404547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 257/498] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:26 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:26.796158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:26.796758 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:26.803014 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:26.803459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:26.804221 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:26.804674 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:26.934393 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:26.942211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:26.943733 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:26.944831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-228c7682-eac7-4688-919c-6f534de82a19 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1407 microversion: 2.20 time: 0.152587 May 12 19:03:26.945388 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 242/499] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:26 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:27.421789 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:27.422439 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:27.428711 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:27.429173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:27.429967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:27.430408 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:27.552582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:27.560372 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3216fd8d-8bdd-4e04-a2d1-8823e1935cf8 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.142961 May 12 19:03:27.560940 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 258/500] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:27 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:27.963196 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:27.963801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:27.970826 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:27.971278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:27.972053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:27.972495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:28.099617 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:28.107258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:28.109314 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:28.110427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-66205cc1-519f-42f4-977c-5acc83648f1d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1407 microversion: 2.20 time: 0.151134 May 12 19:03:28.111148 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 243/501] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:27 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:28.175966 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-def190fc-ec3d-43b0-922b-39025517fb69 req-5b30d635-e0e8-4176-b00a-dc8dd514716e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ff207-805c-42db-9da8-6e493ecdd78e", "name": "network-vif-plugged", "status": "completed", "tag": "d6ee4e3b-c3f4-4c30-877e-37f58454c827"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:28.184153 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-def190fc-ec3d-43b0-922b-39025517fb69 req-5b30d635-e0e8-4176-b00a-dc8dd514716e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:28.184445 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-def190fc-ec3d-43b0-922b-39025517fb69 req-5b30d635-e0e8-4176-b00a-dc8dd514716e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:28.195747 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-def190fc-ec3d-43b0-922b-39025517fb69 req-5b30d635-e0e8-4176-b00a-dc8dd514716e service nova] Creating event network-vif-plugged:d6ee4e3b-c3f4-4c30-877e-37f58454c827 for instance 651ff207-805c-42db-9da8-6e493ecdd78e on hv-cinder-79575 May 12 19:03:28.200753 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-def190fc-ec3d-43b0-922b-39025517fb69 req-5b30d635-e0e8-4176-b00a-dc8dd514716e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028718 May 12 19:03:28.201750 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 259/502] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:28.578206 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:28.578748 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:28.584560 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:28.585008 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:28.585801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:28.586240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:28.715251 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:28.723130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ed308e99-0228-4aae-9057-411ba827fc98 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.149422 May 12 19:03:28.723688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 244/503] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:28 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:29.129804 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:29.130508 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:29.136674 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:29.137131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:29.137939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:29.138382 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:29.264851 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:29.272782 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:29.274325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:29.275466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e3760139-9e47-445c-9a89-3ead8e207cca tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1407 microversion: 2.20 time: 0.150444 May 12 19:03:29.276030 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 260/504] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:29 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:29.739996 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:29.740605 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:29.747285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:29.747730 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:29.748485 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:29.748934 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:29.873239 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:29.880928 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-716a29b8-d76f-4491-9e34-c81d849a9eaf tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.144668 May 12 19:03:29.881491 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 245/505] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:29 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:30.293580 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:30.294188 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:30.300461 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:30.300902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:30.301691 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:30.302124 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:30.429147 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:30.436870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:30.438397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:30.439587 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-08274d65-4cc9-46f8-9c2f-ec2337ce4ed2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1600 microversion: 2.20 time: 0.150030 May 12 19:03:30.440190 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 261/506] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:03:30 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:03:30.457030 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6c0400ce-dd1b-4fb2-9fcd-36433b6d1196 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:30.457544 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6c0400ce-dd1b-4fb2-9fcd-36433b6d1196 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:30.463328 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c0400ce-dd1b-4fb2-9fcd-36433b6d1196 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:30.463770 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c0400ce-dd1b-4fb2-9fcd-36433b6d1196 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:30.464526 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c0400ce-dd1b-4fb2-9fcd-36433b6d1196 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:30.464958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c0400ce-dd1b-4fb2-9fcd-36433b6d1196 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:30.542158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6c0400ce-dd1b-4fb2-9fcd-36433b6d1196 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088715 May 12 19:03:30.542753 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 246/507] 10.222.0.48 () {60 vars in 1315 bytes} [Thu May 12 19:03:30 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:03:30.898340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:30.899043 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:30.905016 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:30.905473 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:30.906284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:30.906716 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:31.107335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:31.115162 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6bebda9d-49d1-4fa9-9f97-5bd06220b143 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.220757 May 12 19:03:31.115729 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 262/508] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:30 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:31.805128 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-d7509edb-9ebb-4634-a0ee-f9cc062f5e7c req-a3e14de0-ac4a-4794-a878-43c2404cffe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651ff207-805c-42db-9da8-6e493ecdd78e", "tag": "d6ee4e3b-c3f4-4c30-877e-37f58454c827"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:31.813504 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d7509edb-9ebb-4634-a0ee-f9cc062f5e7c req-a3e14de0-ac4a-4794-a878-43c2404cffe5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:31.813974 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d7509edb-9ebb-4634-a0ee-f9cc062f5e7c req-a3e14de0-ac4a-4794-a878-43c2404cffe5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:31.824503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-d7509edb-9ebb-4634-a0ee-f9cc062f5e7c req-a3e14de0-ac4a-4794-a878-43c2404cffe5 service nova] Creating event network-changed:d6ee4e3b-c3f4-4c30-877e-37f58454c827 for instance 651ff207-805c-42db-9da8-6e493ecdd78e on hv-cinder-79575 May 12 19:03:31.830150 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-d7509edb-9ebb-4634-a0ee-f9cc062f5e7c req-a3e14de0-ac4a-4794-a878-43c2404cffe5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029014 May 12 19:03:31.830716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 247/509] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:32.134124 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:32.134872 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:32.141147 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:32.141635 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:32.142563 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:32.143070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:32.348390 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:32.360052 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5aca383a-8c9a-4b55-97ff-3730a91de563 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.230208 May 12 19:03:32.370167 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 263/510] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:32 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:33.379291 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:33.379924 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:33.386724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:33.387345 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:33.388113 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:33.388558 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:33.517001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:33.524658 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6e99c9ca-873a-4695-bd05-2d8ae26eef34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.150046 May 12 19:03:33.525212 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 248/511] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:33 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:34.542007 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:34.542616 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:34.549594 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:34.550052 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:34.550814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:34.551252 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:34.679767 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:34.687471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5af30ee0-106a-4613-a10f-32572738e3b1 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.149292 May 12 19:03:34.688041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 264/512] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:34 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:35.704512 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:35.705136 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:35.712398 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:35.712854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:35.713658 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:35.714099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:35.813859 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3f07e828-067d-4f3b-90ef-ddebad9f9ae7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:35.814369 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3f07e828-067d-4f3b-90ef-ddebad9f9ae7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:35.820811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3f07e828-067d-4f3b-90ef-ddebad9f9ae7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:35.821257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3f07e828-067d-4f3b-90ef-ddebad9f9ae7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:35.822072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3f07e828-067d-4f3b-90ef-ddebad9f9ae7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:35.822535 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3f07e828-067d-4f3b-90ef-ddebad9f9ae7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:35.841466 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:35.844598 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3f07e828-067d-4f3b-90ef-ddebad9f9ae7 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/ips" status: 200 len: 149 microversion: 2.1 time: 0.035067 May 12 19:03:35.845175 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 265/513] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:03:35 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:03:35.849413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-896d9e62-935d-41f7-97bc-87945ed2c8b9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.148906 May 12 19:03:35.850669 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 249/514] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:35 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:36.866613 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:36.867266 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:36.874166 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:36.874621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:36.875393 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:36.875829 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:37.050439 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:37.059602 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d06ff297-07f3-47aa-af58-8342f36324f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.196759 May 12 19:03:37.060199 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 266/515] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:36 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:37.144143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-06923e24-aaf4-4b9a-8063-48ec8018f458 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d05d74a-1404-41f2-aa37-2b08039ea8e0"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:37.145222 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-06923e24-aaf4-4b9a-8063-48ec8018f458 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:37.151099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-06923e24-aaf4-4b9a-8063-48ec8018f458 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:37.151543 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-06923e24-aaf4-4b9a-8063-48ec8018f458 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:37.152296 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-06923e24-aaf4-4b9a-8063-48ec8018f458 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:37.152727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-06923e24-aaf4-4b9a-8063-48ec8018f458 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:37.925970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-06923e24-aaf4-4b9a-8063-48ec8018f458 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785650 May 12 19:03:37.926611 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 250/516] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:03:37 2022] POST /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:03:38.077669 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:38.078277 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:38.084913 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:38.085307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:38.086106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:38.086539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:38.221305 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:38.229070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-32cdb8a1-a7cc-4936-824b-178feb099474 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1735 microversion: 2.1 time: 0.155737 May 12 19:03:38.229662 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 267/517] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:38 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:39.246541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:39.247168 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:39.253884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.254334 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.255098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.255533 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.385268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:39.394313 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ab14f423-423c-408d-baf5-60419a207ae2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1715 microversion: 2.1 time: 0.152018 May 12 19:03:39.394880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 251/518] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:39 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:39.492470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:39.492956 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:39.499267 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.499656 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.500762 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.501212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.578726 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] HTTP exception thrown: Cannot 'detach_volume' instance 665565c6-dd25-45be-b6a5-db7fddff10cf while it is in vm_state rescued May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Request method failure captured: May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments/c5f40993-b822-4f4f-a641-60a452a1df94 HTTP/1.1 May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkZ3DcigF-ID2zoLmf1s363r4QO3vxrvUQhwcTQnqDJih2lrCmRgMVtsX4GpNZJg1HEirwReWh9hZaRtvOJGEdXY56qemSBOMjs0s8iQ2IIY0Rw2ZPy_xifAq3NGgdvxE1CEolkngv5KRbpDiIOsXygq85i5f36_14GSCcyF5_OyNo May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:03:39.580315 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb2e124562e34719a49be3de45e6cf37", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 1df4257419c4434fa22edb0805c1a204 May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:03:39.581764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Cannot 'detach_volume' instance 665565c6-dd25-45be-b6a5-db7fddff10cf while it is in vm_state rescued May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'server_id': '665565c6-dd25-45be-b6a5-db7fddff10cf', 'id': 'c5f40993-b822-4f4f-a641-60a452a1df94'} May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 665565c6-dd25-45be-b6a5-db7fddff10cf in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:03:39.582568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 665565c6-dd25-45be-b6a5-db7fddff10cf while it is in vm_state rescued May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 665565c6-dd25-45be-b6a5-db7fddff10cf while it is in vm_state rescued May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:39.583914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Returning 409 to user: Cannot 'detach_volume' instance 665565c6-dd25-45be-b6a5-db7fddff10cf while it is in vm_state rescued {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:03:39.585051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e3d8f1c2-c541-4b7d-8c40-c84783db4e3e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "DELETE /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments/c5f40993-b822-4f4f-a641-60a452a1df94" status: 409 len: 152 microversion: 2.1 time: 0.093252 May 12 19:03:39.585051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 268/519] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:03:39 2022] DELETE /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments/c5f40993-b822-4f4f-a641-60a452a1df94 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 19:03:39.590540 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6c953d66-3567-4054-9a18-f7be5b3ab602 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:39.591076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6c953d66-3567-4054-9a18-f7be5b3ab602 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:39.597688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c953d66-3567-4054-9a18-f7be5b3ab602 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.598140 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c953d66-3567-4054-9a18-f7be5b3ab602 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.598907 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c953d66-3567-4054-9a18-f7be5b3ab602 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.599344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6c953d66-3567-4054-9a18-f7be5b3ab602 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.662184 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6c953d66-3567-4054-9a18-f7be5b3ab602 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "POST /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/action" status: 202 len: 0 microversion: 2.1 time: 0.075283 May 12 19:03:39.663439 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 252/520] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:03:39 2022] POST /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:03:39.670951 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:39.671571 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:39.677469 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.677950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.678727 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:39.679168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:39.892802 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:39.900598 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e72e52a7-ec1c-4a9b-9860-284e2d168f3a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1723 microversion: 2.1 time: 0.233524 May 12 19:03:39.901161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 269/521] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:39 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:40.919256 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:40.920454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:40.926686 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:40.927140 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:40.927912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:40.928351 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:41.056904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:41.067724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d38361cb-8359-4608-83a7-6f6fa4745a46 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1723 microversion: 2.1 time: 0.153121 May 12 19:03:41.068302 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 253/522] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:40 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:42.084092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:42.084742 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:42.091030 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:42.091482 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:42.092753 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:42.093196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:42.223786 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:42.231397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1f7e5c11-bad4-4829-85f0-1cee2a586e87 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1723 microversion: 2.1 time: 0.151150 May 12 19:03:42.231951 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 270/523] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:42 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:43.248245 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:43.248861 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:43.255254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:43.255727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:43.256485 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:43.256918 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:43.381891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:43.390241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-874e8601-4770-4f27-ae9a-5bdc3dad1ff6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1729 microversion: 2.1 time: 0.145736 May 12 19:03:43.390811 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 254/524] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:43 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:43.407392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ad8486ee-e886-44cc-9e06-475a5c8e807b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:43.407897 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ad8486ee-e886-44cc-9e06-475a5c8e807b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:43.414400 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad8486ee-e886-44cc-9e06-475a5c8e807b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:43.414851 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad8486ee-e886-44cc-9e06-475a5c8e807b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:43.415621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad8486ee-e886-44cc-9e06-475a5c8e807b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:43.416060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad8486ee-e886-44cc-9e06-475a5c8e807b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:43.494318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ad8486ee-e886-44cc-9e06-475a5c8e807b tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091568 May 12 19:03:43.494917 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 271/525] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:03:43 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:44.392507 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-114c8d89-d6cc-4146-8a63-b6a5be430c2d req-f1be73d2-af96-45dc-84df-184d4f1e0f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665565c6-dd25-45be-b6a5-db7fddff10cf", "tag": "521e204c-fea5-47a9-a561-25d5d27a554a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:44.401451 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-114c8d89-d6cc-4146-8a63-b6a5be430c2d req-f1be73d2-af96-45dc-84df-184d4f1e0f2f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:44.401995 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-114c8d89-d6cc-4146-8a63-b6a5be430c2d req-f1be73d2-af96-45dc-84df-184d4f1e0f2f service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:44.415408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-114c8d89-d6cc-4146-8a63-b6a5be430c2d req-f1be73d2-af96-45dc-84df-184d4f1e0f2f service nova] Creating event network-changed:521e204c-fea5-47a9-a561-25d5d27a554a for instance 665565c6-dd25-45be-b6a5-db7fddff10cf on hv-cinder-79575 May 12 19:03:44.421244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-114c8d89-d6cc-4146-8a63-b6a5be430c2d req-f1be73d2-af96-45dc-84df-184d4f1e0f2f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032312 May 12 19:03:44.422110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 255/526] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:45.414047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d05d74a-1404-41f2-aa37-2b08039ea8e0"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:45.415237 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:45.421810 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:45.422591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:45.423494 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:45.424002 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:45.500920 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Invalid volume: volume 9d05d74a-1404-41f2-aa37-2b08039ea8e0 is already attached to instances: 87951282-3c6e-4899-9775-022278e4bfa8 May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: POST /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments HTTP/1.1 May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 74 May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:03:45.502548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {"volumeAttachment": {"volumeId": "9d05d74a-1404-41f2-aa37-2b08039ea8e0"}} May 12 19:03:45.504075 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Invalid volume: volume 9d05d74a-1404-41f2-aa37-2b08039ea8e0 is already attached to instances: 87951282-3c6e-4899-9775-022278e4bfa8 May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'server_id': '87951282-3c6e-4899-9775-022278e4bfa8', 'body': {'volumeAttachment': {'volumeId': '9d05d74a-1404-41f2-aa37-2b08039ea8e0'}}} May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9d05d74a-1404-41f2-aa37-2b08039ea8e0 is already attached to instances: 87951282-3c6e-4899-9775-022278e4bfa8 May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:45.504847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9d05d74a-1404-41f2-aa37-2b08039ea8e0 is already attached to instances: 87951282-3c6e-4899-9775-022278e4bfa8 May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:45.506212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9d05d74a-1404-41f2-aa37-2b08039ea8e0 is already attached to instances: 87951282-3c6e-4899-9775-022278e4bfa8 May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 400 to user: Invalid volume: volume 9d05d74a-1404-41f2-aa37-2b08039ea8e0 is already attached to instances: 87951282-3c6e-4899-9775-022278e4bfa8 {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-eb4d170a-5d4e-4745-a0d0-5af4ad836cab tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095202 May 12 19:03:45.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 272/527] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:03:45 2022] POST /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 19:03:45.565966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:45.566546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:45.572708 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:45.573151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:45.573954 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:45.574383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:45.649806 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lazy-loading 'services' on Instance uuid 87951282-3c6e-4899-9775-022278e4bfa8 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:03:45.717007 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3f141c8d-aeee-4ef2-8d38-5a73c2d40d4b tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments/9d05d74a-1404-41f2-aa37-2b08039ea8e0" status: 202 len: 0 microversion: 2.1 time: 0.155514 May 12 19:03:45.717667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 256/528] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:03:45 2022] DELETE /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments/9d05d74a-1404-41f2-aa37-2b08039ea8e0 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:03:45.726949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f5db84a7-dd6a-4b01-9919-c6a32b20328f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:45.727882 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f5db84a7-dd6a-4b01-9919-c6a32b20328f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:45.736105 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5db84a7-dd6a-4b01-9919-c6a32b20328f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:45.736581 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5db84a7-dd6a-4b01-9919-c6a32b20328f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:45.737565 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5db84a7-dd6a-4b01-9919-c6a32b20328f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:45.738076 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5db84a7-dd6a-4b01-9919-c6a32b20328f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:45.772264 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f5db84a7-dd6a-4b01-9919-c6a32b20328f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050022 May 12 19:03:45.772818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 273/529] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:03:45 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:46.435317 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-44d03f64-2c8f-406a-8d27-0d4340ab38e5 req-050a9c79-9bb5-499f-a88b-8d9fd6fece9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665565c6-dd25-45be-b6a5-db7fddff10cf", "tag": "521e204c-fea5-47a9-a561-25d5d27a554a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:46.443498 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-44d03f64-2c8f-406a-8d27-0d4340ab38e5 req-050a9c79-9bb5-499f-a88b-8d9fd6fece9d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:46.443945 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-44d03f64-2c8f-406a-8d27-0d4340ab38e5 req-050a9c79-9bb5-499f-a88b-8d9fd6fece9d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:46.454832 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-44d03f64-2c8f-406a-8d27-0d4340ab38e5 req-050a9c79-9bb5-499f-a88b-8d9fd6fece9d service nova] Creating event network-changed:521e204c-fea5-47a9-a561-25d5d27a554a for instance 665565c6-dd25-45be-b6a5-db7fddff10cf on hv-cinder-79575 May 12 19:03:46.459483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-44d03f64-2c8f-406a-8d27-0d4340ab38e5 req-050a9c79-9bb5-499f-a88b-8d9fd6fece9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028189 May 12 19:03:46.460097 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 257/530] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:46.783931 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-37365de2-e9de-421e-96eb-5fddd6e76383 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:46.785221 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-37365de2-e9de-421e-96eb-5fddd6e76383 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:46.791743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-37365de2-e9de-421e-96eb-5fddd6e76383 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:46.792186 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-37365de2-e9de-421e-96eb-5fddd6e76383 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:46.792958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-37365de2-e9de-421e-96eb-5fddd6e76383 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:46.793407 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-37365de2-e9de-421e-96eb-5fddd6e76383 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:46.822365 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-37365de2-e9de-421e-96eb-5fddd6e76383 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042342 May 12 19:03:46.822929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 274/531] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:03:46 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:03:46.879937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:46.880525 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:46.886583 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:46.887033 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:46.887805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:46.888823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:46.915310 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:03:46.990755 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-686e13d5-20c0-4e54-adab-c4f6cb1e6e7c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 204 len: 0 microversion: 2.1 time: 0.115080 May 12 19:03:46.994618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 258/532] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:03:46 2022] DELETE /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:03:47.000285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:47.000997 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:47.007136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:47.007693 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:47.008544 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:47.009062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:47.140790 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:47.148031 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-74bc7b90-b911-496c-8414-97802d74e083 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1680 microversion: 2.1 time: 0.152235 May 12 19:03:47.148593 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 275/533] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:46 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:48.166062 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:48.167052 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:48.173918 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:48.174366 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:48.175135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:48.175567 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:48.301541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:48.309227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a12011d5-809f-4fe6-a577-74953f5e15ec tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1680 microversion: 2.1 time: 0.147657 May 12 19:03:48.310328 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 259/534] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:48 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:49.326313 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:49.326923 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:49.333230 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:49.333709 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:49.334473 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:49.334906 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:49.563214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:49.570479 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5b8a8fe4-4baf-4b7f-af0a-e4c2b2f1dea5 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1680 microversion: 2.1 time: 0.248014 May 12 19:03:49.571050 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 276/535] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:49 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:50.030731 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-6392df7d-0e7b-485b-ab71-5eeae07b9629 req-04da6858-d3f2-4e44-b74f-d05862b0a15c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87951282-3c6e-4899-9775-022278e4bfa8", "name": "network-vif-deleted", "tag": "1cfe36b5-8273-4971-b681-1637c5aa6837"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:50.040304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-6392df7d-0e7b-485b-ab71-5eeae07b9629 req-04da6858-d3f2-4e44-b74f-d05862b0a15c service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:50.040786 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-6392df7d-0e7b-485b-ab71-5eeae07b9629 req-04da6858-d3f2-4e44-b74f-d05862b0a15c service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:50.052684 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-6392df7d-0e7b-485b-ab71-5eeae07b9629 req-04da6858-d3f2-4e44-b74f-d05862b0a15c service nova] Creating event network-vif-deleted:1cfe36b5-8273-4971-b681-1637c5aa6837 for instance 87951282-3c6e-4899-9775-022278e4bfa8 on hv-cinder-79575 May 12 19:03:50.059301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-6392df7d-0e7b-485b-ab71-5eeae07b9629 req-04da6858-d3f2-4e44-b74f-d05862b0a15c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 May 12 19:03:50.061906 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 260/536] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:50.587245 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:50.588470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:50.594992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:50.595449 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:50.596228 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:50.596669 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:50.628288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:50.628758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:50.629211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lazy-loading 'fault' on Instance uuid 87951282-3c6e-4899-9775-022278e4bfa8 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:03:50.675184 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:50.683270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c27afb13-8db5-4181-a3a7-357bc892fbbd tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 200 len: 1332 microversion: 2.1 time: 0.099766 May 12 19:03:50.684191 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 277/537] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:50 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:51.700996 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:51.701718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:51.707788 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:51.708258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:51.709216 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:51.709759 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:51.723863 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 HTTP/1.1 May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:03:51.725460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:03:51.726925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '87951282-3c6e-4899-9775-022278e4bfa8'} May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:03:51.727704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:03:51.729082 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:03:51.730396 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:03:51.730396 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-521cdc0d-d8b2-4673-9805-1c0b1a62d0bb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 404 len: 111 microversion: 2.1 time: 0.030472 May 12 19:03:51.730396 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 261/538] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:51 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:03:51.736001 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-69d7d715-2398-4814-ad3c-64c37260d5b8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '.version_select at 0x7f38c2426a60>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:51.753783 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-69d7d715-2398-4814-ad3c-64c37260d5b8 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461001543" status: 202 len: 0 microversion: 2.1 time: 0.021856 May 12 19:03:51.754335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 278/539] 10.222.0.48 () {58 vars in 1220 bytes} [Thu May 12 19:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461001543 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:03:52.358823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-96db07c4-a6d8-4e2d-bdd6-1273af8ee3b4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: .version_select at 0x7f38c23ae280>, body: {"keypair": {"name": "tempest-keypair-1556244412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUS/vdBsgPNNm4r/r1O0jn0ddJJUG4gezDkX7go2k5m7kIId6AnbSTlZWjkxyAMvkv1Eehvp/UArCJ982w53QQ0T+kFTGCGXVUtA/bSiFPyQ7HyDBBNJEbQv+QgbidB4Q=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:52.372712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-96db07c4-a6d8-4e2d-bdd6-1273af8ee3b4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:03:52.376519 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-96db07c4-a6d8-4e2d-bdd6-1273af8ee3b4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:03:52.398898 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-96db07c4-a6d8-4e2d-bdd6-1273af8ee3b4 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043919 May 12 19:03:52.399493 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 262/540] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:03:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:53.610886 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-369340431", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b"}], "security_groups": [{"name": "tempest-securitygroup--1879224735"}], "key_name": "tempest-keypair-1556244412", "user_data": "}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:53.709258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] validate_networks() for [('5ae0b4cc-f6f2-4dd0-b614-d89f8247bf9b', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:03:54.065180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:03:54.065568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:03:54.066051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:03:54.066461 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:03:54.066922 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:03:54.075980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:54.076422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:54.077223 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:54.077692 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:54.093501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:03:54.097338 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Getting quotas for user e1ebd0110fff4620b11e881c90470cda and project 1579004868f04df3baa3ad959277ba00. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:03:54.108386 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:03:54.110681 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:03:54.156893 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c98a964f-47a2-4fda-a5cb-daa2f20f1d58 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.550079 May 12 19:03:54.157575 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 279/541] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:03:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:03:54.168125 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3e85ba45-3927-4473-8492-0852968e06f3 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:54.168741 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3e85ba45-3927-4473-8492-0852968e06f3 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:54.229441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3e85ba45-3927-4473-8492-0852968e06f3 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:54.237473 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3e85ba45-3927-4473-8492-0852968e06f3 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1241 microversion: 2.1 time: 0.073541 May 12 19:03:54.237988 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 263/542] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:54 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:55.177266 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-59563155-7495-480c-8910-23051537a8ca tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:55.178615 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-59563155-7495-480c-8910-23051537a8ca tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:55.185820 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59563155-7495-480c-8910-23051537a8ca tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.186274 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59563155-7495-480c-8910-23051537a8ca tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.187043 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59563155-7495-480c-8910-23051537a8ca tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.187479 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-59563155-7495-480c-8910-23051537a8ca tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.224511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-59563155-7495-480c-8910-23051537a8ca tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050902 May 12 19:03:55.227251 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 280/543] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:03:55 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:03:55.253467 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:55.254958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:55.261278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.262146 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.265226 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.265860 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.292678 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:55.293178 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:55.299225 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.299902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.300839 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.301473 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.327817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:03:55.348333 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:55.361172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6d9eaac7-56e9-4683-b67b-12a4d884cefc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1311 microversion: 2.1 time: 0.111272 May 12 19:03:55.361772 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 264/544] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:55 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:55.405099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5363323b-3835-427b-9f03-1c2f1ddedfce tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 204 len: 0 microversion: 2.1 time: 0.116114 May 12 19:03:55.405725 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 281/545] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:03:55 2022] DELETE /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 19:03:55.414318 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:55.414955 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:55.420993 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.421435 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.422241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:55.422674 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:55.620757 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:55.628970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-14b4568f-b29f-468f-9ca6-1aa2d965eca4 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1673 microversion: 2.1 time: 0.218774 May 12 19:03:55.629757 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 265/546] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:55 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:56.379345 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:56.379960 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:56.386214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:56.386666 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:56.387443 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:56.387884 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:56.516356 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:56.523819 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-186cf736-9d29-4d09-b43f-b79ae907f03d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.148781 May 12 19:03:56.524385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 282/547] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:56 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:56.646009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:56.646555 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:56.652857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:56.653894 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:56.654664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:56.655099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:56.780731 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:56.788249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0a29ae65-6d9d-471e-a75f-eae65d35d52d tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1673 microversion: 2.1 time: 0.146200 May 12 19:03:56.788814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 266/548] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:56 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:57.540264 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:57.540975 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:57.547366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:57.547822 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:57.548594 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:57.549031 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:57.766547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:57.774004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1ad78b05-8595-4f12-af8d-006f5a2d6378 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.237189 May 12 19:03:57.774558 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 283/549] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:57 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:57.805409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:57.806167 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:57.813138 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:57.813702 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:57.814551 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:57.815064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:58.130061 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:58.138865 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-90a35185-188d-4dfc-a51b-e1011f81d619 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1673 microversion: 2.1 time: 0.337212 May 12 19:03:58.139643 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 267/550] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:57 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1673 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:03:58.620639 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-4385c74c-ee4a-48e2-bab9-ce519947823e req-5ed4615c-498c-4929-b63b-eb55fd82a505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e0320c-b957-4332-9135-008d05fe800d", "tag": "90e7efaf-e7a7-4ba1-b899-4974cb0deb3d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:03:58.630823 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-4385c74c-ee4a-48e2-bab9-ce519947823e req-5ed4615c-498c-4929-b63b-eb55fd82a505 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:58.631480 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-4385c74c-ee4a-48e2-bab9-ce519947823e req-5ed4615c-498c-4929-b63b-eb55fd82a505 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:58.645866 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-4385c74c-ee4a-48e2-bab9-ce519947823e req-5ed4615c-498c-4929-b63b-eb55fd82a505 service nova] Creating event network-changed:90e7efaf-e7a7-4ba1-b899-4974cb0deb3d for instance 22e0320c-b957-4332-9135-008d05fe800d on hv-cinder-79575 May 12 19:03:58.651578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-4385c74c-ee4a-48e2-bab9-ce519947823e req-5ed4615c-498c-4929-b63b-eb55fd82a505 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036314 May 12 19:03:58.652256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 284/551] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:03:58.790720 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:58.791418 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:58.797915 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:58.798705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:58.800047 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:58.800556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:59.156658 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:03:59.157370 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:03:59.164088 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:59.164746 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:59.165742 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:03:59.166328 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:03:59.333353 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:59.340713 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-11805ba3-0bca-4cc4-bd0e-226644ddb279 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1605 microversion: 2.1 time: 0.188230 May 12 19:03:59.341287 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 285/552] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:59 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1605 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:03:59.379743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:03:59.387254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2206a9a4-ba85-48c0-8485-130d431908fa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.600282 May 12 19:03:59.387767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 268/553] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:03:58 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:04:00.357871 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:00.358500 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:00.365042 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:00.365483 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:00.366277 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:00.366715 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:00.401141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:00.401957 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:00.402566 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lazy-loading 'fault' on Instance uuid 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:04:00.404636 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:00.405580 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:00.412815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:00.413664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:00.414667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:00.415315 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:00.451144 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:00.459463 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1d48723c-d0fe-4b7f-8cc8-ca3ff78f7345 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 200 len: 1327 microversion: 2.1 time: 0.105507 May 12 19:04:00.460262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 286/554] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:00 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:00.550607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:00.557894 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2dce5948-b6ef-49ab-bb5a-605d76abf135 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.158109 May 12 19:04:00.558637 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 269/555] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:00 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:04:00.667227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-92172500-619c-417a-9028-b5d473914669 req-4b754199-33fe-445a-ade0-fdb36ceb67ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b6a7d2-7257-49f6-9b8d-69d6a3909dc1", "name": "network-vif-deleted", "tag": "45a2c903-cdc6-44e2-9c9e-1c74da169ec7"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:00.676079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-92172500-619c-417a-9028-b5d473914669 req-4b754199-33fe-445a-ade0-fdb36ceb67ba service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:00.676526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-92172500-619c-417a-9028-b5d473914669 req-4b754199-33fe-445a-ade0-fdb36ceb67ba service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:00.692775 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-92172500-619c-417a-9028-b5d473914669 req-4b754199-33fe-445a-ade0-fdb36ceb67ba service nova] Creating event network-vif-deleted:45a2c903-cdc6-44e2-9c9e-1c74da169ec7 for instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 on hv-cinder-79575 May 12 19:04:00.697698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-92172500-619c-417a-9028-b5d473914669 req-4b754199-33fe-445a-ade0-fdb36ceb67ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 May 12 19:04:00.698317 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 287/556] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:01.476219 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:01.476743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:01.483671 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:01.484116 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:01.484881 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:01.485353 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:01.498132 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] HTTP exception thrown: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Request method failure captured: May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 HTTP/1.1 May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkO67neL0xgcWgkaOBSLhwF25pb2hs35yXSZ6_Hd8A13uioXb8O4sJwPi7Ishb7eJNrexJ5_sbtgB2ODlM0aqI-SdLuPntZ-Dy14UacNABBxwzBUXFFT_UNi2r8kkQqSgG5gwGD5l1OrsQyqE--EYcaCR8gH2_BZTgI-yn9j_Lfwig May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:04:01.499625 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a61f3c6e7974486a9f3a4f9d361c5fb6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeTestJSON-1348022541 May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 2c202a7f2c484cd3b0363b75c1a673a3 May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:04:01.501089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '44b6a7d2-7257-49f6-9b8d-69d6a3909dc1'} May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:01.501958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:04:01.503218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:01.504271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Returning 404 to user: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:01.504271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-378d9eb6-71d5-402f-851f-bddadaaa6240 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 404 len: 111 microversion: 2.1 time: 0.028703 May 12 19:04:01.504271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 270/557] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:01 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:04:01.510282 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d432805d-7260-4f94-84e8-56e6760bf421 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '.version_select at 0x7f38c250c430>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:01.526736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d432805d-7260-4f94-84e8-56e6760bf421 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215958706" status: 202 len: 0 microversion: 2.1 time: 0.020454 May 12 19:04:01.527294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 288/558] 10.222.0.48 () {58 vars in 1217 bytes} [Thu May 12 19:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215958706 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:04:01.576622 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:01.577255 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:01.585554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:01.586024 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:01.586814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:01.587256 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:01.723400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:01.731154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e011c3cb-c285-4df8-bf4a-373375d2e9ee tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.159615 May 12 19:04:01.731637 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 271/559] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:01 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:02.345949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8f3e4dd1-e895-4338-a9cc-7dbc61074495 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'create', calling method: .version_select at 0x7f38c25384c0>, body: {"keypair": {"name": "tempest-keypair-1974088322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy8zF+1sk+xyp0FFkrwvqCY0TL2BqwG3+PDI0MxRsZ8LQ6DSRsgqpk0dNzLXEiV4wdsBF1a/NOVytJhI45v6CBQMtGWTAWvSR1HGdh2d4UM0qnsvL/PLm5TGuFeLYDXBw=="}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:02.360156 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-8f3e4dd1-e895-4338-a9cc-7dbc61074495 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:04:02.364003 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-8f3e4dd1-e895-4338-a9cc-7dbc61074495 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for user 2c202a7f2c484cd3b0363b75c1a673a3 and project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:04:02.394591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8f3e4dd1-e895-4338-a9cc-7dbc61074495 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052557 May 12 19:04:02.395203 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 289/560] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:04:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:02.747818 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:02.748436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:02.754964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:02.755413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:02.756189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:02.756624 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:02.900124 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:02.908413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6539f577-b47b-421c-b1d5-c90227a488aa tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.164312 May 12 19:04:02.909421 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 272/561] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:02 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:03.686361 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1245102548", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dc5243f-8a82-4161-97c5-4250a7dc2b56"}], "security_groups": [{"name": "tempest-securitygroup--869727694"}], "key_name": "tempest-keypair-1974088322", "user_data": "}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:03.784113 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] validate_networks() for [('3dc5243f-8a82-4161-97c5-4250a7dc2b56', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:04:03.925550 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:03.926188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:03.932501 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:03.932955 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:03.933763 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:03.934797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:04.149130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:04.157148 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a474b994-4fc6-4a46-8675-f836b7e8b53c tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.235335 May 12 19:04:04.157739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 273/562] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:03 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:04:04.231683 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:04:04.232439 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:04:04.232903 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:04:04.233310 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:04:04.233758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:04:04.242171 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:04.242615 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:04.243407 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:04.243845 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:04.260776 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:04:04.265174 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Getting quotas for user 2c202a7f2c484cd3b0363b75c1a673a3 and project a61f3c6e7974486a9f3a4f9d361c5fb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:04:04.275774 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:04:04.278681 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:04:04.325973 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b9bf88a5-bf61-4030-8bf7-ffe260ce876e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644936 May 12 19:04:04.326557 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 290/563] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:04:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:04:04.336379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b5fcf791-6379-406b-9462-27b293d7aae8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:04.336990 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b5fcf791-6379-406b-9462-27b293d7aae8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:04.382473 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-c1857e5d-6cb9-442c-ad31-9c9572a8ef4a req-be82a9a0-cd3e-4f4c-a41e-feb577c82e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e0320c-b957-4332-9135-008d05fe800d", "name": "network-vif-plugged", "status": "completed", "tag": "90e7efaf-e7a7-4ba1-b899-4974cb0deb3d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:04.395498 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b5fcf791-6379-406b-9462-27b293d7aae8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:04.396893 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-c1857e5d-6cb9-442c-ad31-9c9572a8ef4a req-be82a9a0-cd3e-4f4c-a41e-feb577c82e8c service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:04.397723 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-c1857e5d-6cb9-442c-ad31-9c9572a8ef4a req-be82a9a0-cd3e-4f4c-a41e-feb577c82e8c service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:04.404128 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b5fcf791-6379-406b-9462-27b293d7aae8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1238 microversion: 2.1 time: 0.071435 May 12 19:04:04.404748 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 274/564] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:04 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:04:04.411294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-c1857e5d-6cb9-442c-ad31-9c9572a8ef4a req-be82a9a0-cd3e-4f4c-a41e-feb577c82e8c service nova] Creating event network-vif-plugged:90e7efaf-e7a7-4ba1-b899-4974cb0deb3d for instance 22e0320c-b957-4332-9135-008d05fe800d on hv-cinder-79575 May 12 19:04:04.416242 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-c1857e5d-6cb9-442c-ad31-9c9572a8ef4a req-be82a9a0-cd3e-4f4c-a41e-feb577c82e8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038752 May 12 19:04:04.419156 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 291/565] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:05.173724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:05.174265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:05.180550 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:05.180998 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:05.181817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:05.182278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:05.313134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:05.320791 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-33d17fb9-870a-433d-8ba5-34031812a5cc tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1367 microversion: 2.1 time: 0.150970 May 12 19:04:05.321366 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 275/566] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:05 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:05.422662 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:05.423403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:05.429610 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:05.430066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:05.430842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:05.431286 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:05.492293 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:05.500180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-442942e7-fc45-4e1d-8801-8bb1a2c275b8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1234 microversion: 2.1 time: 0.082696 May 12 19:04:05.500750 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 292/567] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:05 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:06.338226 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:06.339249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:06.348228 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:06.348719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:06.349516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:06.349969 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:06.479180 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:06.486546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dfcb0c97-94f5-429e-ab17-de8852bf148a tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1556 microversion: 2.1 time: 0.152864 May 12 19:04:06.487105 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 276/568] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:06 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:06.502950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1e048e28-5ae3-4a77-a5ae-db91cc3a1793 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:06.503468 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1e048e28-5ae3-4a77-a5ae-db91cc3a1793 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:06.509747 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1e048e28-5ae3-4a77-a5ae-db91cc3a1793 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:06.510206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1e048e28-5ae3-4a77-a5ae-db91cc3a1793 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:06.510972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1e048e28-5ae3-4a77-a5ae-db91cc3a1793 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:06.511417 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1e048e28-5ae3-4a77-a5ae-db91cc3a1793 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:06.517151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:06.517794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:06.523588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:06.524037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:06.524809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:06.525248 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:06.600576 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:06.607807 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-25437db7-68c2-49e1-932a-520fa924fa8f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1298 microversion: 2.1 time: 0.094466 May 12 19:04:06.608379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 277/569] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:06 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:04:06.610226 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1e048e28-5ae3-4a77-a5ae-db91cc3a1793 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110432 May 12 19:04:06.616258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 293/570] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:04:06 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:07.624404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:07.624932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:07.633056 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:07.633411 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:07.635138 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-35a395fb-9538-410b-82d6-38044389c1fd req-d27723bb-36d6-4333-b04e-7d10e2df16a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e0320c-b957-4332-9135-008d05fe800d", "tag": "90e7efaf-e7a7-4ba1-b899-4974cb0deb3d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:07.642445 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:07.642445 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:07.648921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-35a395fb-9538-410b-82d6-38044389c1fd req-d27723bb-36d6-4333-b04e-7d10e2df16a1 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:07.650843 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-35a395fb-9538-410b-82d6-38044389c1fd req-d27723bb-36d6-4333-b04e-7d10e2df16a1 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:07.680982 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-35a395fb-9538-410b-82d6-38044389c1fd req-d27723bb-36d6-4333-b04e-7d10e2df16a1 service nova] Creating event network-changed:90e7efaf-e7a7-4ba1-b899-4974cb0deb3d for instance 22e0320c-b957-4332-9135-008d05fe800d on hv-cinder-79575 May 12 19:04:07.687092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-35a395fb-9538-410b-82d6-38044389c1fd req-d27723bb-36d6-4333-b04e-7d10e2df16a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056105 May 12 19:04:07.687920 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 294/571] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:08.002025 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:08.010091 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ef8e9787-86a3-4436-a812-773d4320442c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.389622 May 12 19:04:08.010671 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 278/572] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:07 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:09.001257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-66772e64-ef47-4c69-89c8-922aa26f0326 req-04ac6878-8a7b-46e7-89b3-b28d50be8ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d9a1db-4ae5-4e5d-bc0f-eae936fc362c", "tag": "5e762846-9002-4df1-9a78-c923c3f1fc21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:09.013109 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-66772e64-ef47-4c69-89c8-922aa26f0326 req-04ac6878-8a7b-46e7-89b3-b28d50be8ff5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:09.014433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-66772e64-ef47-4c69-89c8-922aa26f0326 req-04ac6878-8a7b-46e7-89b3-b28d50be8ff5 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:09.025497 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-66772e64-ef47-4c69-89c8-922aa26f0326 req-04ac6878-8a7b-46e7-89b3-b28d50be8ff5 service nova] Creating event network-changed:5e762846-9002-4df1-9a78-c923c3f1fc21 for instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c on hv-cinder-79575 May 12 19:04:09.030920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:09.031571 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-66772e64-ef47-4c69-89c8-922aa26f0326 req-04ac6878-8a7b-46e7-89b3-b28d50be8ff5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034080 May 12 19:04:09.032279 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:09.032622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 295/573] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:09.042450 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:09.043149 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:09.044123 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:09.044741 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:09.267060 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:09.274926 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-196ac771-f81e-4c16-a6b8-fc4664e3fba8 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.249214 May 12 19:04:09.275517 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 279/574] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:09 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:10.294416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:10.295113 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:10.301490 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:10.301978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:10.302783 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:10.303227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:10.434503 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:10.441674 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b395c306-8fab-45c3-8497-80018e1410e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.152446 May 12 19:04:10.442231 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 296/575] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:10 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:11.458145 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:11.458762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:11.465131 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:11.465600 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:11.466375 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:11.466812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:11.591366 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:11.598646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7c936395-aea2-4439-9807-cb456a93183f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.144364 May 12 19:04:11.599216 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 280/576] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:11 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:12.615468 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:12.616076 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:12.623086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:12.623568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:12.624445 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:12.625048 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:12.758518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:12.767752 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d5a8331f-ef2f-4027-beda-b3e8ed705e2f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.156074 May 12 19:04:12.768403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 297/577] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:12 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:13.784958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:13.785642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:13.792586 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:13.793037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:13.794327 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:13.794766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:13.923517 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:13.930759 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8cf386b3-2af9-4bad-b833-c22918ee111a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.149901 May 12 19:04:13.931306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 281/578] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:13 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:14.464196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-de882725-74df-40e7-a2b0-38aafd8e5ccc req-5a137c19-3a5d-4752-a41e-54046cab9ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d9a1db-4ae5-4e5d-bc0f-eae936fc362c", "name": "network-vif-plugged", "status": "completed", "tag": "5e762846-9002-4df1-9a78-c923c3f1fc21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:14.473212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-de882725-74df-40e7-a2b0-38aafd8e5ccc req-5a137c19-3a5d-4752-a41e-54046cab9ed2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:14.473681 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-de882725-74df-40e7-a2b0-38aafd8e5ccc req-5a137c19-3a5d-4752-a41e-54046cab9ed2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:14.486503 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-de882725-74df-40e7-a2b0-38aafd8e5ccc req-5a137c19-3a5d-4752-a41e-54046cab9ed2 service nova] Creating event network-vif-plugged:5e762846-9002-4df1-9a78-c923c3f1fc21 for instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c on hv-cinder-79575 May 12 19:04:14.491435 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-de882725-74df-40e7-a2b0-38aafd8e5ccc req-5a137c19-3a5d-4752-a41e-54046cab9ed2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030820 May 12 19:04:14.492034 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 298/579] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:14.947179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:14.947867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:14.954749 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:14.955199 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:14.955992 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:14.956430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:15.084884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:15.092160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-66faf903-e35f-4a36-8af6-3ff2233140a6 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.148810 May 12 19:04:15.092726 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 282/580] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:14 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:15.439855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a780962a-d73b-46f4-9fb1-bf2a9ccb946a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:15.440568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a780962a-d73b-46f4-9fb1-bf2a9ccb946a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:15.446748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a780962a-d73b-46f4-9fb1-bf2a9ccb946a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:15.447193 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a780962a-d73b-46f4-9fb1-bf2a9ccb946a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:15.447958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a780962a-d73b-46f4-9fb1-bf2a9ccb946a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:15.448389 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a780962a-d73b-46f4-9fb1-bf2a9ccb946a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:15.471831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a780962a-d73b-46f4-9fb1-bf2a9ccb946a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/ips" status: 200 len: 153 microversion: 2.20 time: 0.036088 May 12 19:04:15.472472 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 299/581] 10.222.0.48 () {60 vars in 1288 bytes} [Thu May 12 19:04:15 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:04:16.108378 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:16.109000 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:16.115309 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:16.115753 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:16.116680 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:16.117114 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:16.250044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:16.257313 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dff0aeff-a487-4a77-8999-84a1fd2ede16 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1363 microversion: 2.1 time: 0.152961 May 12 19:04:16.257904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 283/582] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:16 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:17.274314 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:17.275069 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:17.281407 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.281882 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:17.282640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.283328 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:17.303997 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:17.304537 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:17.311378 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.311832 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:17.312606 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.313043 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:17.335222 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lazy-loading 'flavor' on Instance uuid 651ff207-805c-42db-9da8-6e493ecdd78e {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:04:17.417311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:17.425428 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-934df4f4-af13-4a73-a2c5-921296a811fd tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1549 microversion: 2.1 time: 0.154896 May 12 19:04:17.426019 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 300/583] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:17 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:17.441946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-05e060a0-745d-42a4-b410-9348a0936559 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:17.442444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-05e060a0-745d-42a4-b410-9348a0936559 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:17.450407 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-05e060a0-745d-42a4-b410-9348a0936559 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.450860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-05e060a0-745d-42a4-b410-9348a0936559 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:17.451663 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-05e060a0-745d-42a4-b410-9348a0936559 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.452099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-05e060a0-745d-42a4-b410-9348a0936559 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:17.528550 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-05e060a0-745d-42a4-b410-9348a0936559 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090222 May 12 19:04:17.529286 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 301/584] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 12 19:04:17 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:17.777123 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-10c86f97-19c9-4cc2-a4bb-d235bb278ab4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/action" status: 202 len: 0 microversion: 2.20 time: 0.476918 May 12 19:04:17.777774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 284/585] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 12 19:04:17 2022] POST /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 19:04:17.786507 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:17.787151 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:17.793226 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.793722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:17.794510 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:17.795493 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:18.027161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:18.035137 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:18.036611 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:18.037786 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-485bcf11-53fd-4611-aa31-523de006c5bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.255369 May 12 19:04:18.038342 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 302/586] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:17 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:18.836405 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-569ac55c-de32-45f5-a929-a26295ac6816 req-cdec0176-5e49-4722-9220-a9960a27a9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d9a1db-4ae5-4e5d-bc0f-eae936fc362c", "tag": "5e762846-9002-4df1-9a78-c923c3f1fc21"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:18.845154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-569ac55c-de32-45f5-a929-a26295ac6816 req-cdec0176-5e49-4722-9220-a9960a27a9e7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:18.845621 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-569ac55c-de32-45f5-a929-a26295ac6816 req-cdec0176-5e49-4722-9220-a9960a27a9e7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:18.856324 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-569ac55c-de32-45f5-a929-a26295ac6816 req-cdec0176-5e49-4722-9220-a9960a27a9e7 service nova] Creating event network-changed:5e762846-9002-4df1-9a78-c923c3f1fc21 for instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c on hv-cinder-79575 May 12 19:04:18.861104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-569ac55c-de32-45f5-a929-a26295ac6816 req-cdec0176-5e49-4722-9220-a9960a27a9e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029262 May 12 19:04:18.861795 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 285/587] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:19.056630 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:19.057491 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:19.064812 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:19.065266 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:19.066081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:19.066523 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:19.375528 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:19.387078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:19.389157 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:19.390412 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c809c9c4-1130-4355-bd96-807d294aaa9e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.337696 May 12 19:04:19.390970 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 303/588] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:19 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:20.409899 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:20.410553 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:20.416672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:20.417124 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:20.417921 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:20.418358 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:20.548640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:20.562719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:20.564213 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:20.565382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bcb8323c-b03f-40d4-935a-c2376438a808 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.160620 May 12 19:04:20.565981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 286/589] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:20 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:21.583472 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:21.584077 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:21.590363 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:21.590807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:21.591558 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:21.591987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:21.716318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:21.724035 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:21.725572 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:21.726717 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9f299922-f312-43e8-badd-af256b18c08d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.147186 May 12 19:04:21.727270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 304/590] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:21 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:22.410135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:22.410668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:22.416850 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:22.417293 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:22.418076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:22.418508 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:22.496915 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lazy-loading 'services' on Instance uuid 665565c6-dd25-45be-b6a5-db7fddff10cf {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:04:22.567272 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4513b6c5-7b0d-426b-be77-a874807e6ba3 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "DELETE /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments/c5f40993-b822-4f4f-a641-60a452a1df94" status: 202 len: 0 microversion: 2.1 time: 0.161164 May 12 19:04:22.567946 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 287/591] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:04:22 2022] DELETE /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments/c5f40993-b822-4f4f-a641-60a452a1df94 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:04:22.577444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7851714b-d4a7-4558-99cc-985012021889 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:22.578545 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7851714b-d4a7-4558-99cc-985012021889 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:22.585292 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7851714b-d4a7-4558-99cc-985012021889 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:22.585944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7851714b-d4a7-4558-99cc-985012021889 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:22.586954 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7851714b-d4a7-4558-99cc-985012021889 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:22.588026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7851714b-d4a7-4558-99cc-985012021889 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:22.619456 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7851714b-d4a7-4558-99cc-985012021889 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 May 12 19:04:22.620017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 305/592] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:04:22 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:22.745628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:22.746330 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:22.752454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:22.752906 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:22.753703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:22.754145 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:22.882836 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:22.891237 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:22.892769 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:22.893955 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ad3dbccd-988a-452b-b087-e6d3ff173d04 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.152558 May 12 19:04:22.894525 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 288/593] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:22 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:23.631645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3aed2eac-6347-48f9-932d-63dcc2b132f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:23.632605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3aed2eac-6347-48f9-932d-63dcc2b132f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:23.638813 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3aed2eac-6347-48f9-932d-63dcc2b132f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:23.639262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3aed2eac-6347-48f9-932d-63dcc2b132f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:23.640029 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3aed2eac-6347-48f9-932d-63dcc2b132f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:23.640460 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3aed2eac-6347-48f9-932d-63dcc2b132f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:23.670909 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3aed2eac-6347-48f9-932d-63dcc2b132f6 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 May 12 19:04:23.671471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 306/594] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:04:23 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:23.911827 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:23.912436 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:23.918685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:23.919143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:23.920546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:23.920980 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:24.051300 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:24.059232 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:24.060756 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:24.061951 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b2379406-f95d-4f81-9089-36b33caec8eb tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.154198 May 12 19:04:24.062540 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 289/595] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:23 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:24.682700 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a67a3451-5c1e-4faa-aa62-3c3c214fa91c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:24.683648 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a67a3451-5c1e-4faa-aa62-3c3c214fa91c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:24.690340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a67a3451-5c1e-4faa-aa62-3c3c214fa91c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:24.690789 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a67a3451-5c1e-4faa-aa62-3c3c214fa91c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:24.691551 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a67a3451-5c1e-4faa-aa62-3c3c214fa91c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:24.691981 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a67a3451-5c1e-4faa-aa62-3c3c214fa91c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:24.723252 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a67a3451-5c1e-4faa-aa62-3c3c214fa91c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044515 May 12 19:04:24.723883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 307/596] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:04:24 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:04:24.793831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:24.794805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:24.800682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:24.801135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:24.801927 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:24.802361 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:24.827635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:04:24.903046 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7cade7ff-81d7-47e5-95b3-a70075ce9c12 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "DELETE /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 204 len: 0 microversion: 2.1 time: 0.112748 May 12 19:04:24.905740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 290/597] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:04:24 2022] DELETE /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:04:24.911835 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:24.912458 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:24.918317 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:24.918776 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:24.920066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:24.920511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:25.048821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:25.056204 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-925d52f1-9383-4631-b7f7-050a50cc51cd tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1689 microversion: 2.1 time: 0.148468 May 12 19:04:25.056772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 308/598] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:24 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:04:25.079646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:25.080353 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:25.086593 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:25.087049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:25.087817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:25.088257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:25.216443 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:25.224320 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:25.225854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:25.227016 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-47494af5-a2a9-4cc9-8a8d-f994b693d4da tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.151570 May 12 19:04:25.227580 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 291/599] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:25 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:26.073130 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:26.073772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:26.080677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:26.081131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:26.081933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:26.082378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:26.213131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:26.220422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-978a46ea-1e3f-4779-a30a-03ab9e91101f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1689 microversion: 2.1 time: 0.151181 May 12 19:04:26.220984 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 309/600] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:26 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:26.243940 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:26.244545 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:26.251409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:26.251850 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:26.252604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:26.253039 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:26.376298 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:26.383943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:26.385435 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:26.386600 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c2956a48-813f-4b10-ac64-07f48972002b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.146545 May 12 19:04:26.387154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 292/601] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:26 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:27.237547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:27.238186 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:27.244529 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:27.244987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:27.245788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:27.246235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:27.374254 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:27.381678 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-44ae151d-bcad-4dcf-93b8-04f183cfcc75 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1689 microversion: 2.1 time: 0.147905 May 12 19:04:27.382258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 310/602] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:27 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:27.404185 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:27.405104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:27.411876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:27.412350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:27.413105 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:27.413599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:27.540774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:27.550583 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:27.552923 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:27.554149 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7f00389f-7189-48aa-a9e7-8f854ebf9a1a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.153909 May 12 19:04:27.554706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 293/603] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:27 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:28.399832 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:28.400379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:28.406720 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:28.407167 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:28.408189 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:28.408627 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:28.573427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:28.574678 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:28.581505 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:28.581977 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:28.582767 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:28.583198 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:28.601271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:28.608655 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-de26598c-04ff-410f-b62d-6e9f2c6e377f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1689 microversion: 2.1 time: 0.212770 May 12 19:04:28.609230 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 311/604] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:28 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:28.830487 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:28.838262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:28.839834 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:28.841687 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-44d0956a-41d0-47f9-bb9d-2d86b1ff3ff2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.271544 May 12 19:04:28.842252 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 294/605] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:28 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:04:29.626204 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:29.626818 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:29.632986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:29.633436 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:29.634232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:29.634665 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:29.709407 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-d572bf82-50b1-46e3-8d1c-3ece9969c08a req-d43861be-cd1d-4b70-8221-01310dc692cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665565c6-dd25-45be-b6a5-db7fddff10cf", "name": "network-vif-deleted", "tag": "521e204c-fea5-47a9-a561-25d5d27a554a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:29.723704 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:29.724705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d572bf82-50b1-46e3-8d1c-3ece9969c08a req-d43861be-cd1d-4b70-8221-01310dc692cd service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:29.725145 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d572bf82-50b1-46e3-8d1c-3ece9969c08a req-d43861be-cd1d-4b70-8221-01310dc692cd service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:29.731939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-20bd381d-3b1d-4410-b6b9-e4affc920b34 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 200 len: 1622 microversion: 2.1 time: 0.110061 May 12 19:04:29.732887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 312/606] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:29 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 1622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:29.756998 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-d572bf82-50b1-46e3-8d1c-3ece9969c08a req-d43861be-cd1d-4b70-8221-01310dc692cd service nova] Creating event network-vif-deleted:521e204c-fea5-47a9-a561-25d5d27a554a for instance 665565c6-dd25-45be-b6a5-db7fddff10cf on hv-cinder-79575 May 12 19:04:29.762131 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-d572bf82-50b1-46e3-8d1c-3ece9969c08a req-d43861be-cd1d-4b70-8221-01310dc692cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056845 May 12 19:04:29.762783 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 295/607] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:29.860415 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:29.861021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:29.867456 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:29.868261 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:29.869126 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:29.869666 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:30.002817 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:30.010706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:30.012222 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:30.013987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4a19b2b4-0ae4-4744-a990-101a67e10c0a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.158137 May 12 19:04:30.014555 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 313/608] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:29 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:30.752503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:30.753217 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 665565c6-dd25-45be-b6a5-db7fddff10cf] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:30.759617 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:30.760073 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:30.760861 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:30.761352 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:30.775246 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] HTTP exception thrown: Instance 665565c6-dd25-45be-b6a5-db7fddff10cf could not be found. May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Request method failure captured: May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf HTTP/1.1 May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkZ3DcigF-ID2zoLmf1s363r4QO3vxrvUQhwcTQnqDJih2lrCmRgMVtsX4GpNZJg1HEirwReWh9hZaRtvOJGEdXY56qemSBOMjs0s8iQ2IIY0Rw2ZPy_xifAq3NGgdvxE1CEolkngv5KRbpDiIOsXygq85i5f36_14GSCcyF5_OyNo May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:04:30.776920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb2e124562e34719a49be3de45e6cf37", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 1df4257419c4434fa22edb0805c1a204 May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 665565c6-dd25-45be-b6a5-db7fddff10cf could not be found. May 12 19:04:30.779164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '665565c6-dd25-45be-b6a5-db7fddff10cf'} May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665565c6-dd25-45be-b6a5-db7fddff10cf could not be found. May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:30.779984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665565c6-dd25-45be-b6a5-db7fddff10cf could not be found. May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665565c6-dd25-45be-b6a5-db7fddff10cf could not be found. May 12 19:04:30.781808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:30.784346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Returning 404 to user: Instance 665565c6-dd25-45be-b6a5-db7fddff10cf could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:30.784346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-19a2c4da-8ec7-43f3-ae5c-3b88017e2b1a tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf" status: 404 len: 111 microversion: 2.1 time: 0.031567 May 12 19:04:30.784346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 296/609] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:30 2022] GET /compute/v2.1/servers/665565c6-dd25-45be-b6a5-db7fddff10cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:04:30.788518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-37d95c18-c281-418e-976c-44864c02a587 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '.version_select at 0x7f38c26658b0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:30.805483 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-37d95c18-c281-418e-976c-44864c02a587 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-778954759" status: 202 len: 0 microversion: 2.1 time: 0.021115 May 12 19:04:30.806100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 314/610] 10.222.0.48 () {58 vars in 1217 bytes} [Thu May 12 19:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-778954759 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:04:31.031760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:31.032286 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:31.038433 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:31.038879 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:31.039637 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:31.040066 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:31.239562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:31.247509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:31.249001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:31.250214 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-42edbf43-fc79-4c31-a254-abb8dfa3cda9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.222476 May 12 19:04:31.250766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 297/611] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:31 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:32.268653 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:32.269296 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:32.276037 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:32.276489 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:32.277252 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:32.277734 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:32.411826 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:32.419591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:32.421072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:32.422323 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d6152bce-f52f-44b2-bbe0-4f32a2fb1edd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.158085 May 12 19:04:32.422875 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 315/612] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:32 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:33.440675 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:33.441289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:33.447611 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:33.448048 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:33.448801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:33.449229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:33.573605 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:33.581890 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:33.583370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:33.584523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bd209495-5988-46fd-a79d-92d450903f84 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.147714 May 12 19:04:33.585073 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 298/613] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:33 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:33.718066 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:33.718592 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:33.724789 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:33.725236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:33.726028 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:33.726466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:33.754591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:04:33.828912 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-58c06b06-a020-4337-9b6d-943656fcc895 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "DELETE /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 204 len: 0 microversion: 2.1 time: 0.115083 May 12 19:04:33.829497 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 316/614] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:04:33 2022] DELETE /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:04:33.837538 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:33.838156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:33.844942 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:33.845394 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:33.846204 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:33.846672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:33.971395 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:33.978774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8749ce02-c474-476f-b8f9-a598f03d68b7 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1508 microversion: 2.1 time: 0.145031 May 12 19:04:33.979330 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 299/615] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:33 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:04:34.603201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:34.603955 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:34.609976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:34.610426 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:34.611196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:34.611634 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:34.742256 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:34.750565 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:34.752054 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:34.753215 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6277fedc-7959-491a-8ed3-60594c891422 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1746 microversion: 2.20 time: 0.154340 May 12 19:04:34.753811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 317/616] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:34 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:34.996099 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:34.996705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:35.003540 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:35.004118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:35.004741 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:35.005265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:35.129694 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:35.137110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-fceb4a3b-8667-48f4-9ff2-035c1839bf8f tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1508 microversion: 2.1 time: 0.144825 May 12 19:04:35.138248 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 300/617] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:34 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:35.771617 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:35.772222 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:35.778990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:35.779434 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:35.780192 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:35.780626 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:35.909282 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:35.917013 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:35.918531 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:35.920247 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d3730e2d-aa52-4fb2-9a68-757eadeaf36b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1746 microversion: 2.20 time: 0.152490 May 12 19:04:35.920806 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 318/618] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:35 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:36.155247 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:36.155864 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:36.162439 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:36.162884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:36.163646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:36.164081 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:36.291011 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:36.298595 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9bb78e11-49fb-4a65-8ab3-b81b032ca744 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1508 microversion: 2.1 time: 0.147808 May 12 19:04:36.299171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 301/619] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:36 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:36.938522 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:36.939184 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:36.945559 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:36.946035 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:36.946811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:36.947249 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:37.164159 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:37.173446 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:37.175669 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:37.178370 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b79e883d-ffe8-4d5e-804c-9e8c087d521f tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.243767 May 12 19:04:37.179746 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 319/620] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:36 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:37.315926 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:37.318431 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:37.329109 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:37.329853 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:37.331064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:37.331668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:37.649191 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:37.661879 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4ae4ed49-efb2-47df-afa2-ed0c8215c13d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 200 len: 1466 microversion: 2.1 time: 0.349761 May 12 19:04:37.662434 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 302/621] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:37 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 1466 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:37.669887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-0bc5324b-dd32-4751-8795-77c1d3c37499 req-63f6007a-908e-4b4a-a675-3b46676be923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398fab6a-ea82-46a2-907a-5c98b273d143", "name": "network-vif-deleted", "tag": "48557972-00a2-459a-88df-83a565897bd6"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:37.682459 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-0bc5324b-dd32-4751-8795-77c1d3c37499 req-63f6007a-908e-4b4a-a675-3b46676be923 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:37.683238 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-0bc5324b-dd32-4751-8795-77c1d3c37499 req-63f6007a-908e-4b4a-a675-3b46676be923 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:37.700961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-0bc5324b-dd32-4751-8795-77c1d3c37499 req-63f6007a-908e-4b4a-a675-3b46676be923 service nova] Creating event network-vif-deleted:48557972-00a2-459a-88df-83a565897bd6 for instance 398fab6a-ea82-46a2-907a-5c98b273d143 on hv-cinder-79575 May 12 19:04:37.707100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-0bc5324b-dd32-4751-8795-77c1d3c37499 req-63f6007a-908e-4b4a-a675-3b46676be923 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048119 May 12 19:04:37.708005 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 320/622] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:38.197399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:38.198905 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:38.207549 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.208369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.209467 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.209994 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.377964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:38.386938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:38.388742 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:38.390245 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6ebccb49-f660-4005-b9cd-16ab6125b5d6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.197138 May 12 19:04:38.391685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 303/623] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:38 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:04:38.579293 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-877bf939-9a13-495c-ad2f-9762f37713de req-f70df4bb-b469-4eef-853c-d8e5ae5dcb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ff207-805c-42db-9da8-6e493ecdd78e", "name": "network-vif-plugged", "status": "completed", "tag": "d6ee4e3b-c3f4-4c30-877e-37f58454c827"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:38.589633 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-877bf939-9a13-495c-ad2f-9762f37713de req-f70df4bb-b469-4eef-853c-d8e5ae5dcb9a service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.590410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-877bf939-9a13-495c-ad2f-9762f37713de req-f70df4bb-b469-4eef-853c-d8e5ae5dcb9a service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.607880 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-877bf939-9a13-495c-ad2f-9762f37713de req-f70df4bb-b469-4eef-853c-d8e5ae5dcb9a service nova] Creating event network-vif-plugged:d6ee4e3b-c3f4-4c30-877e-37f58454c827 for instance 651ff207-805c-42db-9da8-6e493ecdd78e on hv-cinder-79575 May 12 19:04:38.613175 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-877bf939-9a13-495c-ad2f-9762f37713de req-f70df4bb-b469-4eef-853c-d8e5ae5dcb9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039431 May 12 19:04:38.614249 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 321/624] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:38.683081 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:38.683993 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 398fab6a-ea82-46a2-907a-5c98b273d143] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:38.690657 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.691339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.692271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.692711 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.707602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] HTTP exception thrown: Instance 398fab6a-ea82-46a2-907a-5c98b273d143 could not be found. May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Request method failure captured: May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 HTTP/1.1 May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkZ3DcigF-ID2zoLmf1s363r4QO3vxrvUQhwcTQnqDJih2lrCmRgMVtsX4GpNZJg1HEirwReWh9hZaRtvOJGEdXY56qemSBOMjs0s8iQ2IIY0Rw2ZPy_xifAq3NGgdvxE1CEolkngv5KRbpDiIOsXygq85i5f36_14GSCcyF5_OyNo May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:04:38.709119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb2e124562e34719a49be3de45e6cf37", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 1df4257419c4434fa22edb0805c1a204 May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 398fab6a-ea82-46a2-907a-5c98b273d143 could not be found. May 12 19:04:38.710667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '398fab6a-ea82-46a2-907a-5c98b273d143'} May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398fab6a-ea82-46a2-907a-5c98b273d143 could not be found. May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:38.711482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398fab6a-ea82-46a2-907a-5c98b273d143 could not be found. May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398fab6a-ea82-46a2-907a-5c98b273d143 could not be found. May 12 19:04:38.712878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:38.715299 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Returning 404 to user: Instance 398fab6a-ea82-46a2-907a-5c98b273d143 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:38.716835 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5b8280e6-cec8-4acf-b626-1021be11171c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143" status: 404 len: 111 microversion: 2.1 time: 0.037639 May 12 19:04:38.717414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 304/625] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:38 2022] GET /compute/v2.1/servers/398fab6a-ea82-46a2-907a-5c98b273d143 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 19:04:38.726811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:38.727404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:38.734322 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.734978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.735751 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.736190 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.765790 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:04:38.852047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9d3aa58f-1031-47dc-85ca-43c204be8b24 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 204 len: 0 microversion: 2.1 time: 0.129202 May 12 19:04:38.852705 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 322/626] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:04:38 2022] DELETE /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:04:38.861637 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:38.862495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:38.868432 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.868957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:38.869765 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:38.870141 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:39.011429 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:39.024103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1e6d9412-5880-462d-9b44-d1597b6631b2 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.166811 May 12 19:04:39.024917 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 305/627] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:38 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:39.419146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:39.419804 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:39.426032 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:39.426708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:39.427696 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:39.428135 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:39.577997 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:39.588979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:39.591211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:39.592576 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a6315b15-81b6-465d-8b78-3a91651e5144 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.177821 May 12 19:04:39.593627 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 323/628] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:39 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:40.042232 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:40.044184 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:40.050702 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:40.051758 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:40.052879 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:40.053422 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:40.195257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:40.203985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c680d1f1-104f-4adb-a2cb-3b3b3f6b21f9 tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.165454 May 12 19:04:40.204779 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 306/629] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:40 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:40.615156 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:40.617337 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:40.624530 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:40.625240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:40.626246 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:40.626743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:40.792709 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:40.804451 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:40.806404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:40.807762 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bceaa1f4-4e89-4fe7-a77e-7cc541202915 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.200685 May 12 19:04:40.808312 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 324/630] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:40 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:41.222402 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:41.222933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:41.231513 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:41.232006 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:41.232797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:41.233236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:41.371271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:41.378886 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8dcea751-0f67-43fc-8851-c9a6193deb1d tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.160479 May 12 19:04:41.380151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 307/631] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:41 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:41.826537 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:41.827813 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:41.834708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:41.835162 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:41.835950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:41.836386 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:41.972131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:41.979980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:41.981560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:41.982729 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-21210b3d-88fc-432f-9bbb-eb451eedc7c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.160104 May 12 19:04:41.983286 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 325/632] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:41 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:42.396941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:42.398158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:42.405678 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:42.406478 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:42.425317 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:42.426057 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:42.570554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:42.578308 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8edb981c-5c5a-4866-a4f1-8e1895d38d5e tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1522 microversion: 2.1 time: 0.185163 May 12 19:04:42.578880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 308/633] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:42 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:43.000911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:43.001730 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:43.007991 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:43.008519 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:43.009620 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:43.010170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:43.199700 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-af771a2c-8eef-4b31-9dd6-616c1d04d98a req-79ba6067-454d-4e34-bb22-a3dad5a18e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1351fe24-18b4-4cb5-b54f-33595df43567", "name": "network-vif-deleted", "tag": "892d0c20-1c89-4582-aee5-a3cc582f961d"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:43.210846 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-af771a2c-8eef-4b31-9dd6-616c1d04d98a req-79ba6067-454d-4e34-bb22-a3dad5a18e1d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:43.211528 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-af771a2c-8eef-4b31-9dd6-616c1d04d98a req-79ba6067-454d-4e34-bb22-a3dad5a18e1d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:43.226147 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-af771a2c-8eef-4b31-9dd6-616c1d04d98a req-79ba6067-454d-4e34-bb22-a3dad5a18e1d service nova] Creating event network-vif-deleted:892d0c20-1c89-4582-aee5-a3cc582f961d for instance 1351fe24-18b4-4cb5-b54f-33595df43567 on hv-cinder-79575 May 12 19:04:43.234298 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-af771a2c-8eef-4b31-9dd6-616c1d04d98a req-79ba6067-454d-4e34-bb22-a3dad5a18e1d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037936 May 12 19:04:43.236573 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 309/634] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:43.249568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:43.257930 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:43.259677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:43.261010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ee771dd3-79fa-4ffb-bbea-a3b41936c9c7 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.264595 May 12 19:04:43.261612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 326/635] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:42 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:04:43.602273 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:43.603597 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:43.615521 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:43.616174 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:43.618346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:43.620398 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:43.663995 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:43.664470 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:43.664921 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lazy-loading 'fault' on Instance uuid 1351fe24-18b4-4cb5-b54f-33595df43567 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:04:43.720153 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1df4257419c4434fa22edb0805c1a204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2e124562e34719a49be3de45e6cf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:43.728454 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ee3615ed-e873-427c-b628-71757881c14c tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 200 len: 1311 microversion: 2.1 time: 0.136799 May 12 19:04:43.729301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 310/636] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:43 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:04:44.279813 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:44.280496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:44.287054 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:44.287506 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:44.288471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:44.289084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:44.435294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:44.444842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:44.446675 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:44.447930 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3ef8101f-ffbb-402f-8bea-659221e834d3 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.172673 May 12 19:04:44.448659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 327/637] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:44 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:04:44.746899 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:44.747606 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] [instance: 1351fe24-18b4-4cb5-b54f-33595df43567] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:44.754561 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:44.755103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:44.755967 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:44.756409 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:44.774859 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] HTTP exception thrown: Instance 1351fe24-18b4-4cb5-b54f-33595df43567 could not be found. May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Request method failure captured: May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 HTTP/1.1 May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkZ3DcigF-ID2zoLmf1s363r4QO3vxrvUQhwcTQnqDJih2lrCmRgMVtsX4GpNZJg1HEirwReWh9hZaRtvOJGEdXY56qemSBOMjs0s8iQ2IIY0Rw2ZPy_xifAq3NGgdvxE1CEolkngv5KRbpDiIOsXygq85i5f36_14GSCcyF5_OyNo May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:04:44.777971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb2e124562e34719a49be3de45e6cf37", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb2e124562e34719a49be3de45e6cf37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: eb2e124562e34719a49be3de45e6cf37 May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1318067792 May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 1df4257419c4434fa22edb0805c1a204 May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1318067792-project May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 1351fe24-18b4-4cb5-b54f-33595df43567 could not be found. May 12 19:04:44.779562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '1351fe24-18b4-4cb5-b54f-33595df43567'} May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1351fe24-18b4-4cb5-b54f-33595df43567 could not be found. May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:44.780441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1351fe24-18b4-4cb5-b54f-33595df43567 could not be found. May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1351fe24-18b4-4cb5-b54f-33595df43567 could not be found. May 12 19:04:44.782676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:44.783956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] Returning 404 to user: Instance 1351fe24-18b4-4cb5-b54f-33595df43567 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:44.784443 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0d2926c1-5088-4a72-b026-fc8bb73b5bab tempest-ServerRescueNegativeTestJSON-1318067792 tempest-ServerRescueNegativeTestJSON-1318067792-project] 10.222.0.48 "GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567" status: 404 len: 111 microversion: 2.1 time: 0.041387 May 12 19:04:44.790781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 311/638] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:04:44 2022] GET /compute/v2.1/servers/1351fe24-18b4-4cb5-b54f-33595df43567 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:04:45.538305 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:45.539596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:45.550604 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:45.551081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:45.551870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:45.552310 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:45.808360 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:45.816955 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:45.818499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:45.819737 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f13c57c0-7150-4e4f-9e38-03066ec741f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.356899 May 12 19:04:45.820499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 328/639] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:45 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:46.838902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:46.839598 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:46.846915 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:46.847620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:46.848134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:46.848570 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:47.298775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:47.307148 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:47.309408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:47.310846 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e6a669f5-6c5d-4659-9d0d-5c6384f02d03 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1741 microversion: 2.20 time: 0.475847 May 12 19:04:47.321823 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 312/640] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:46 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1741 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:48.329835 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:48.330466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:48.337136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:48.337629 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:48.338409 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:48.338843 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:48.572169 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:48.579931 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:48.581420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:48.582612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0d56605b-6b44-4386-b192-8cf975d77687 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1723 microversion: 2.20 time: 0.257128 May 12 19:04:48.583167 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 329/641] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:48 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:49.600551 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:49.601164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:49.607953 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:49.608405 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:49.609183 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:49.609642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:49.742151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:49.749947 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:49.751395 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:49.752546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6e0e5c18-7a62-4b0b-a7cc-c762efd460ef tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1723 microversion: 2.20 time: 0.155839 May 12 19:04:49.753545 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 313/642] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:49 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:50.214972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5041ed92-e53c-44f9-93d0-fc1949457e22 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Action: 'create', calling method: .version_select at 0x7f38c23fdd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2006340262"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:50.495211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5041ed92-e53c-44f9-93d0-fc1949457e22 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.398261 May 12 19:04:50.496095 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 330/643] 10.222.0.48 () {60 vars in 1154 bytes} [Thu May 12 19:04:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 19:04:50.507269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-234145d4-cb2d-4c0a-a0db-f0e7cac63710 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c76ebdc0>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:50.563926 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-47efa9aa-8808-4a15-8831-6e61d5a283c4 req-66c8f7e6-faa4-42f1-84f8-f74525faae00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ff207-805c-42db-9da8-6e493ecdd78e", "name": "network-vif-unplugged", "status": "completed", "tag": "d6ee4e3b-c3f4-4c30-877e-37f58454c827"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:50.567228 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-234145d4-cb2d-4c0a-a0db-f0e7cac63710 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76" status: 200 len: 345 microversion: 2.1 time: 0.063907 May 12 19:04:50.567816 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 314/644] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:04:50 2022] GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:50.574899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-47efa9aa-8808-4a15-8831-6e61d5a283c4 req-66c8f7e6-faa4-42f1-84f8-f74525faae00 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:50.575410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-47efa9aa-8808-4a15-8831-6e61d5a283c4 req-66c8f7e6-faa4-42f1-84f8-f74525faae00 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:50.588601 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-47efa9aa-8808-4a15-8831-6e61d5a283c4 req-66c8f7e6-faa4-42f1-84f8-f74525faae00 service nova] Creating event network-vif-unplugged:d6ee4e3b-c3f4-4c30-877e-37f58454c827 for instance 651ff207-805c-42db-9da8-6e493ecdd78e on hv-cinder-79575 May 12 19:04:50.594134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-47efa9aa-8808-4a15-8831-6e61d5a283c4 req-66c8f7e6-faa4-42f1-84f8-f74525faae00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034549 May 12 19:04:50.595146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 331/645] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:50.771381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:50.772020 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:50.778572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:50.779015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:50.779772 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:50.780203 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:50.905926 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:50.914626 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:50.916154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:50.917306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-10c28db7-6865-475a-abfc-8b9be26bcd25 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1666 microversion: 2.20 time: 0.150235 May 12 19:04:50.917907 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 315/646] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:50 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:50.936206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7033943f-ef8b-40a9-abf0-ef647421f9dd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5c0ec9b-7e7d-4299-8d52-6bb14fc03d99"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:50.937346 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7033943f-ef8b-40a9-abf0-ef647421f9dd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:50.943383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7033943f-ef8b-40a9-abf0-ef647421f9dd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:50.943834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7033943f-ef8b-40a9-abf0-ef647421f9dd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:50.944610 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7033943f-ef8b-40a9-abf0-ef647421f9dd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:50.945046 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7033943f-ef8b-40a9-abf0-ef647421f9dd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:51.219879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7033943f-ef8b-40a9-abf0-ef647421f9dd tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288589 May 12 19:04:51.220521 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 332/647] 10.222.0.48 () {62 vars in 1363 bytes} [Thu May 12 19:04:50 2022] POST /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 19:04:51.329402 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-43f71703-c59f-48db-84a4-b1d49801120d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:51.329924 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-43f71703-c59f-48db-84a4-b1d49801120d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:51.335990 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-43f71703-c59f-48db-84a4-b1d49801120d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:51.336427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-43f71703-c59f-48db-84a4-b1d49801120d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:51.337194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-43f71703-c59f-48db-84a4-b1d49801120d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:51.337716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-43f71703-c59f-48db-84a4-b1d49801120d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:51.579341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-43f71703-c59f-48db-84a4-b1d49801120d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-volume_attachments/c5c0ec9b-7e7d-4299-8d52-6bb14fc03d99" status: 202 len: 0 microversion: 2.20 time: 0.253699 May 12 19:04:51.579946 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 316/648] 10.222.0.48 () {60 vars in 1456 bytes} [Thu May 12 19:04:51 2022] DELETE /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-volume_attachments/c5c0ec9b-7e7d-4299-8d52-6bb14fc03d99 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 19:04:51.581623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-db832e7f-1064-4d4e-997f-0c92ede0eed9 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c250c4c0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:51.628092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-db832e7f-1064-4d4e-997f-0c92ede0eed9 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76" status: 200 len: 346 microversion: 2.1 time: 0.051392 May 12 19:04:51.628671 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 333/649] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:04:51 2022] GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:51.635266 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5ea9f358-96cb-465a-a602-8117b869f6f6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:51.635848 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5ea9f358-96cb-465a-a602-8117b869f6f6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:51.639848 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-78d17417-50af-4916-899f-4cc756b68b82 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Action: 'create', calling method: .version_select at 0x7f38c2665b80>, body: {"snapshot": {"volume_id": "e8384c29-ca00-47a4-b092-23932e7d0f76", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-732567684"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:51.642388 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ea9f358-96cb-465a-a602-8117b869f6f6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:51.642838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ea9f358-96cb-465a-a602-8117b869f6f6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:51.643652 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ea9f358-96cb-465a-a602-8117b869f6f6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:51.644087 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ea9f358-96cb-465a-a602-8117b869f6f6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:51.784392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-78d17417-50af-4916-899f-4cc756b68b82 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.148698 May 12 19:04:51.784992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 334/650] 10.222.0.48 () {60 vars in 1161 bytes} [Thu May 12 19:04:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:51.796715 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e4b37d3b-f3a5-4885-97b1-bfd9c5e18055 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c2437dc0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:51.827544 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e4b37d3b-f3a5-4885-97b1-bfd9c5e18055 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 200 len: 286 microversion: 2.1 time: 0.035794 May 12 19:04:51.828274 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 335/651] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:04:51 2022] GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:51.839464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-358d56f6-d582-47f1-a715-4949ab73d37b tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c23a1670>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:51.841753 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5ea9f358-96cb-465a-a602-8117b869f6f6 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "POST /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/action" status: 202 len: 0 microversion: 2.20 time: 0.210299 May 12 19:04:51.845233 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 317/652] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 12 19:04:51 2022] POST /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 19:04:51.850535 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:51.851233 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:51.858438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:51.858896 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:51.859688 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:51.860431 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:51.877436 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-358d56f6-d582-47f1-a715-4949ab73d37b tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.042560 May 12 19:04:51.878158 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 336/653] 10.222.0.48 () {58 vars in 1139 bytes} [Thu May 12 19:04:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:51.888017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-97a937fd-0496-4c70-9dad-86df13cf4782 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c23a1ca0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:51.921379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-97a937fd-0496-4c70-9dad-86df13cf4782 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 200 len: 286 microversion: 2.1 time: 0.037040 May 12 19:04:51.922129 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 337/654] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:04:51 2022] GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:52.024543 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:52.033370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:52.034921 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:52.036080 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b75ea826-3097-49de-a1a8-3b758de36218 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1674 microversion: 2.20 time: 0.189713 May 12 19:04:52.036631 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 318/655] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:51 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:52.936142 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a94ea76f-061f-4140-8c3e-375432aa6c92 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c2437670>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:52.967180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a94ea76f-061f-4140-8c3e-375432aa6c92 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 200 len: 286 microversion: 2.1 time: 0.035794 May 12 19:04:52.967759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 338/656] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:04:52 2022] GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:53.054606 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:53.055209 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:53.062030 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:53.062472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:53.063234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:53.063661 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:53.191235 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:53.195644 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ff07fc09-7563-4ea7-baf3-df80a59640eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:53.196148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ff07fc09-7563-4ea7-baf3-df80a59640eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:53.199426 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:53.200925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:53.202123 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d10cd45d-558e-46e3-bc58-d9c10021c647 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1674 microversion: 2.20 time: 0.151387 May 12 19:04:53.202579 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ff07fc09-7563-4ea7-baf3-df80a59640eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:53.202694 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 319/657] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:53 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:53.203057 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ff07fc09-7563-4ea7-baf3-df80a59640eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:53.203829 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ff07fc09-7563-4ea7-baf3-df80a59640eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:53.204272 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ff07fc09-7563-4ea7-baf3-df80a59640eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:53.227049 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ff07fc09-7563-4ea7-baf3-df80a59640eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/ips" status: 200 len: 149 microversion: 2.1 time: 0.134113 May 12 19:04:53.227623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 339/658] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:04:53 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/ips => generated 149 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:53.978940 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-afd3edb0-9df6-4b45-b31c-efcf99a8eb3f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c24f7af0>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:54.011241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-afd3edb0-9df6-4b45-b31c-efcf99a8eb3f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 200 len: 286 microversion: 2.1 time: 0.036077 May 12 19:04:54.011800 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 320/659] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:04:53 2022] GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:54.221591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:54.222277 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:54.228708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:54.229223 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:54.230032 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:54.230582 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:54.358941 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:54.366852 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:54.368358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:54.369510 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8aff7e24-727e-4229-9754-83252ec7e014 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1674 microversion: 2.20 time: 0.152485 May 12 19:04:54.370099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 340/660] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:54 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:55.025897 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-69570b5e-33a0-4bb7-9de1-f8b11f006bc1 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c235b310>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:55.054627 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-69570b5e-33a0-4bb7-9de1-f8b11f006bc1 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 200 len: 287 microversion: 2.1 time: 0.033294 May 12 19:04:55.055180 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 321/661] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:04:55 2022] GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:55.065149 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c7f8f495-c178-4e69-8668-14bf8c89d5de tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c23a4af0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:55.120058 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c7f8f495-c178-4e69-8668-14bf8c89d5de tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 202 len: 0 microversion: 2.1 time: 0.058586 May 12 19:04:55.121234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 341/662] 10.222.0.48 () {58 vars in 1253 bytes} [Thu May 12 19:04:55 2022] DELETE /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:04:55.129291 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9401e1d5-c77c-4dfc-9a9a-7f49e958efa7 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c76eb0d0>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:55.159241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9401e1d5-c77c-4dfc-9a9a-7f49e958efa7 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 200 len: 286 microversion: 2.1 time: 0.033717 May 12 19:04:55.159966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 322/663] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:04:55 2022] GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:55.391100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:55.391837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:55.397606 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:55.398062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:55.398831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:55.399270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:55.581333 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-35df7e46-5bbf-4f9a-a0ca-37b7cfd2d06d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0aee071-660f-4729-8f72-965e14a746e8"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:55.582635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-35df7e46-5bbf-4f9a-a0ca-37b7cfd2d06d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:55.590356 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-35df7e46-5bbf-4f9a-a0ca-37b7cfd2d06d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:55.590804 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-35df7e46-5bbf-4f9a-a0ca-37b7cfd2d06d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:55.591587 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-35df7e46-5bbf-4f9a-a0ca-37b7cfd2d06d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:55.592021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-35df7e46-5bbf-4f9a-a0ca-37b7cfd2d06d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:55.617321 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:55.625964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:55.627680 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:55.629186 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bb3a1edd-34fe-4c35-9246-d50ca3b05769 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.242873 May 12 19:04:55.630052 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 342/664] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:55 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:55.869504 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-35df7e46-5bbf-4f9a-a0ca-37b7cfd2d06d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "POST /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292022 May 12 19:04:55.870076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 323/665] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:04:55 2022] POST /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:04:56.171612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9982b622-4cf3-4be4-b050-f3e5b2238efb tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c23a9d30>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:56.195270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-9982b622-4cf3-4be4-b050-f3e5b2238efb tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] HTTP exception thrown: Snapshot 21225ddb-5398-419f-9283-42087da0fb07 could not be found. May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9982b622-4cf3-4be4-b050-f3e5b2238efb tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Request method failure captured: May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 HTTP/1.1 May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVpSJS304zWq_2xggMCWhIomfyV9Op9KowuA3v_7WQHdQN8jP1AV4wVCEnhIHJQiVr74OIl2xeyfSKPyb3t0ql4DlqW4VqDT5XTktTHZYRknBCnzH45tnx-SB_DhnQIZ2i2I1s3OlxfinxsDZIvVWYzKjMB0yFBsrPC_Wj7f9gsS2Jw May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:04:56.197591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cf3cff5264994280a73b27f733497d99", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cf3cff5264994280a73b27f733497d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 77fe4509d4c140cb94b4dc18adc60b85 May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Snapshot 21225ddb-5398-419f-9283-42087da0fb07 could not be found. May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '21225ddb-5398-419f-9283-42087da0fb07'} May 12 19:04:56.199307 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 21225ddb-5398-419f-9283-42087da0fb07 could not be found. (HTTP 404) (Request-ID: req-854faddb-38b1-47f9-a630-63ad50cfd849) May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:56.200552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 19:04:56.201899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 21225ddb-5398-419f-9283-42087da0fb07 could not be found. May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 19:04:56.203308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 21225ddb-5398-419f-9283-42087da0fb07 could not be found. May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 21225ddb-5398-419f-9283-42087da0fb07 could not be found. May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9982b622-4cf3-4be4-b050-f3e5b2238efb tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Returning 404 to user: Snapshot 21225ddb-5398-419f-9283-42087da0fb07 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9982b622-4cf3-4be4-b050-f3e5b2238efb tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07" status: 404 len: 111 microversion: 2.1 time: 0.032068 May 12 19:04:56.204698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 343/666] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:04:56 2022] GET /compute/v2.1/os-snapshots/21225ddb-5398-419f-9283-42087da0fb07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:04:56.208485 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5d34b5fb-e13b-494f-a51b-c73fcaccf9cc tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c76eb3a0>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:56.269573 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5d34b5fb-e13b-494f-a51b-c73fcaccf9cc tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76" status: 202 len: 0 microversion: 2.1 time: 0.065501 May 12 19:04:56.273569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 324/667] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:04:56 2022] DELETE /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:04:56.279573 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ddd27f3a-c4ad-4910-acaa-a818e4abb17f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c23a43a0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:56.407879 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ddd27f3a-c4ad-4910-acaa-a818e4abb17f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76" status: 200 len: 345 microversion: 2.1 time: 0.132527 May 12 19:04:56.408571 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 344/668] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:04:56 2022] GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:56.650352 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:56.652892 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:56.663722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:56.664495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:56.667720 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:56.668787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:56.864323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:56.872646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:56.874270 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:56.875418 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-14c2ef43-52b8-46ae-bbe6-ba9a0e722098 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.231281 May 12 19:04:56.875979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 325/669] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:56 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:04:57.421139 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-cbe2aeff-684f-4c29-945d-060ab49260a3 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c23a9160>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:57.451194 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-cbe2aeff-684f-4c29-945d-060ab49260a3 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] HTTP exception thrown: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-cbe2aeff-684f-4c29-945d-060ab49260a3 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Request method failure captured: May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 HTTP/1.1 May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVpSJS304zWq_2xggMCWhIomfyV9Op9KowuA3v_7WQHdQN8jP1AV4wVCEnhIHJQiVr74OIl2xeyfSKPyb3t0ql4DlqW4VqDT5XTktTHZYRknBCnzH45tnx-SB_DhnQIZ2i2I1s3OlxfinxsDZIvVWYzKjMB0yFBsrPC_Wj7f9gsS2Jw May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:04:57.453176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cf3cff5264994280a73b27f733497d99", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cf3cff5264994280a73b27f733497d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 77fe4509d4c140cb94b4dc18adc60b85 May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': 'e8384c29-ca00-47a4-b092-23932e7d0f76'} May 12 19:04:57.454706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. (HTTP 404) (Request-ID: req-148e8570-64ca-4d98-9709-0450261b1a10) May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.455609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 19:04:57.456937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 19:04:57.458168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-cbe2aeff-684f-4c29-945d-060ab49260a3 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Returning 404 to user: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-cbe2aeff-684f-4c29-945d-060ab49260a3 tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76" status: 404 len: 109 microversion: 2.1 time: 0.037801 May 12 19:04:57.459284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 345/670] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:04:57 2022] GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:04:57.471084 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bb45ca39-e8b7-4eb6-97ea-1f8cee055d0f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c76eb8b0>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:57.498612 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-bb45ca39-e8b7-4eb6-97ea-1f8cee055d0f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] HTTP exception thrown: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bb45ca39-e8b7-4eb6-97ea-1f8cee055d0f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Request method failure captured: May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: DELETE /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 HTTP/1.1 May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVpSJS304zWq_2xggMCWhIomfyV9Op9KowuA3v_7WQHdQN8jP1AV4wVCEnhIHJQiVr74OIl2xeyfSKPyb3t0ql4DlqW4VqDT5XTktTHZYRknBCnzH45tnx-SB_DhnQIZ2i2I1s3OlxfinxsDZIvVWYzKjMB0yFBsrPC_Wj7f9gsS2Jw May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:04:57.500668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cf3cff5264994280a73b27f733497d99", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cf3cff5264994280a73b27f733497d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 77fe4509d4c140cb94b4dc18adc60b85 May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'e8384c29-ca00-47a4-b092-23932e7d0f76'} May 12 19:04:57.502229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. (HTTP 404) (Request-ID: req-015469d0-3036-465f-87c4-a2eed6d5d8a8) May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.503867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 19:04:57.505224 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 19:04:57.506527 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bb45ca39-e8b7-4eb6-97ea-1f8cee055d0f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Returning 404 to user: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bb45ca39-e8b7-4eb6-97ea-1f8cee055d0f tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76" status: 404 len: 109 microversion: 2.1 time: 0.034833 May 12 19:04:57.507855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 326/671] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:04:57 2022] DELETE /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:04:57.510545 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e65b06db-c77a-41cd-95be-63f6fd672daa tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Calling method '.version_select at 0x7f38c23a4940>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:57.537422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-e65b06db-c77a-41cd-95be-63f6fd672daa tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] HTTP exception thrown: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e65b06db-c77a-41cd-95be-63f6fd672daa tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Request method failure captured: May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 HTTP/1.1 May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVpSJS304zWq_2xggMCWhIomfyV9Op9KowuA3v_7WQHdQN8jP1AV4wVCEnhIHJQiVr74OIl2xeyfSKPyb3t0ql4DlqW4VqDT5XTktTHZYRknBCnzH45tnx-SB_DhnQIZ2i2I1s3OlxfinxsDZIvVWYzKjMB0yFBsrPC_Wj7f9gsS2Jw May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:04:57.539358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cf3cff5264994280a73b27f733497d99", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cf3cff5264994280a73b27f733497d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf3cff5264994280a73b27f733497d99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: cf3cff5264994280a73b27f733497d99 May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756091702 May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 77fe4509d4c140cb94b4dc18adc60b85 May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756091702-project May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': 'e8384c29-ca00-47a4-b092-23932e7d0f76'} May 12 19:04:57.540840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. (HTTP 404) (Request-ID: req-4d904b56-c827-4624-9e9e-f3b8bd180cf2) May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.541883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 19:04:57.543808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 19:04:57.545106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e65b06db-c77a-41cd-95be-63f6fd672daa tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] Returning 404 to user: Volume e8384c29-ca00-47a4-b092-23932e7d0f76 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e65b06db-c77a-41cd-95be-63f6fd672daa tempest-VolumesSnapshotsTestJSON-756091702 tempest-VolumesSnapshotsTestJSON-756091702-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76" status: 404 len: 109 microversion: 2.1 time: 0.033946 May 12 19:04:57.546453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 346/672] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:04:57 2022] GET /compute/v2.1/os-volumes/e8384c29-ca00-47a4-b092-23932e7d0f76 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:04:57.893216 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:57.893950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:57.900122 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:57.900822 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:57.902404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:57.903085 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:57.973677 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-232c69d8-07be-48c8-b04b-28c8f111a61a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:57.974986 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-232c69d8-07be-48c8-b04b-28c8f111a61a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:57.983170 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-232c69d8-07be-48c8-b04b-28c8f111a61a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:57.983629 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-232c69d8-07be-48c8-b04b-28c8f111a61a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:57.984502 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-232c69d8-07be-48c8-b04b-28c8f111a61a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:57.986430 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-232c69d8-07be-48c8-b04b-28c8f111a61a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:58.051664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-232c69d8-07be-48c8-b04b-28c8f111a61a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/ips" status: 200 len: 146 microversion: 2.1 time: 0.262031 May 12 19:04:58.052863 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 327/673] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 12 19:04:57 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/ips => generated 146 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:04:58.237065 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:58.248695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:58.251801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:58.253801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-028fb492-f9bc-4d49-9cc3-9803a1a51d9c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.364263 May 12 19:04:58.256351 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 347/674] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:57 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:04:59.274235 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:04:59.275595 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:59.283154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:59.283829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:59.284844 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:59.285437 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:59.428005 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:59.435946 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:59.437791 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:04:59.438958 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7e07ac7d-9950-46dd-ac49-472d0112e23b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.168647 May 12 19:04:59.439544 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 328/675] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:04:59 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:04:59.560023 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0a08b58e-d45d-4fea-bb66-afdef1a3aaae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "582dc61b-414b-4801-8e79-fce9194940df"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:04:59.561960 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0a08b58e-d45d-4fea-bb66-afdef1a3aaae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:04:59.570607 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a08b58e-d45d-4fea-bb66-afdef1a3aaae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:59.571333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a08b58e-d45d-4fea-bb66-afdef1a3aaae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:04:59.572351 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a08b58e-d45d-4fea-bb66-afdef1a3aaae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:04:59.573021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a08b58e-d45d-4fea-bb66-afdef1a3aaae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:00.458575 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:00.459870 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:00.472421 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:00.473701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:00.474989 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:00.476333 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:00.628376 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:00.636827 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:00.638370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:00.639539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a49054d9-5471-4b6d-9313-d27465f08e01 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.185811 May 12 19:05:00.640100 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 329/676] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:00 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:01.656785 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:01.657403 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:01.663720 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:01.664176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:01.664961 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:01.665401 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:01.835040 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:01.845098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:01.847185 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:01.848569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d8da2ec2-cd63-46b9-93d9-6336ac5c7f4d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.195896 May 12 19:05:01.849212 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 330/677] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:01 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:02.871725 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:02.877379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:02.884829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:02.887910 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:02.888821 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:02.889367 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:03.044370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:03.059999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:03.062273 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:03.065158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-10696143-5e10-4502-9afa-d6bc044f37c8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.201264 May 12 19:05:03.078820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 331/678] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:02 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:05:04.109640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:04.111526 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:04.117202 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:04.117790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:04.118685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:04.119354 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:04.275374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:04.284754 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:04.288563 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:04.290672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1f8a302b-cd88-47b1-ae48-cb4af50dc3ea tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.188157 May 12 19:05:04.292407 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 332/679] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:04 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:05:05.312007 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:05.312734 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:05.323156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:05.323608 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:05.324397 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:05.324835 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:05.477261 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:05.491040 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:05.492465 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:05.493964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-386bcc4a-1dfb-45ae-aac3-e74669b8c9bc tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.186323 May 12 19:05:05.503049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 333/680] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:05 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:05:06.512858 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:06.513489 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:06.519895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:06.520416 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:06.521260 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:06.521813 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:06.654598 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:06.662547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:06.664056 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:06.665219 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-fc9f4afe-7f67-4b0a-a6ad-3981fb4e1fa4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.156951 May 12 19:05:06.665808 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 334/681] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:06 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:05:07.116958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0a08b58e-d45d-4fea-bb66-afdef1a3aaae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.560812 May 12 19:05:07.117605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 348/682] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:04:59 2022] POST /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments => generated 194 bytes in 7562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:07.683399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:07.684024 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:07.690396 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:07.690848 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:07.691623 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:07.692063 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:07.831305 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:07.839387 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:07.841407 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:07.842598 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ec07a775-9db8-43fa-9044-8e763120370c tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.163719 May 12 19:05:07.843159 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 335/683] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:07 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:08.855396 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:08.855979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:08.862001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:08.862711 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:08.863478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:08.863990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:08.865119 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:08.865695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:08.870831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:08.871305 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:08.872074 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:08.872690 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:08.947505 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lazy-loading 'services' on Instance uuid 22e0320c-b957-4332-9135-008d05fe800d {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:05:09.012814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:09.018321 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-364d7347-0215-46d3-912f-55dfe2e2a1eb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments/f0aee071-660f-4729-8f72-965e14a746e8" status: 202 len: 0 microversion: 2.1 time: 0.168365 May 12 19:05:09.018942 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 349/684] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:05:08 2022] DELETE /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments/f0aee071-660f-4729-8f72-965e14a746e8 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:05:09.022614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:09.025478 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:09.027261 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e9ee6abe-d429-4654-888a-d0b72c16e070 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.169569 May 12 19:05:09.028001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 336/685] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:08 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:09.028119 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-52ef7ce2-fe48-447a-83d9-eb24cb3689bf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:09.028942 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-52ef7ce2-fe48-447a-83d9-eb24cb3689bf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:09.035476 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52ef7ce2-fe48-447a-83d9-eb24cb3689bf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:09.035937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52ef7ce2-fe48-447a-83d9-eb24cb3689bf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:09.036716 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52ef7ce2-fe48-447a-83d9-eb24cb3689bf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:09.037155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-52ef7ce2-fe48-447a-83d9-eb24cb3689bf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:09.066937 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-52ef7ce2-fe48-447a-83d9-eb24cb3689bf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 May 12 19:05:09.067499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 350/686] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:09 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:05:10.046423 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:10.047196 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:10.054089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:10.054529 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:10.055297 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:10.055729 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:10.079276 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f009c367-ca70-4272-8c47-6982a49e096e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:10.080799 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f009c367-ca70-4272-8c47-6982a49e096e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:10.089948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f009c367-ca70-4272-8c47-6982a49e096e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:10.090405 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f009c367-ca70-4272-8c47-6982a49e096e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:10.091189 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f009c367-ca70-4272-8c47-6982a49e096e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:10.091773 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f009c367-ca70-4272-8c47-6982a49e096e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:10.132268 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f009c367-ca70-4272-8c47-6982a49e096e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057585 May 12 19:05:10.132858 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 351/687] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:10 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:05:10.195805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:10.204302 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:10.205809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:10.206974 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b51614cf-ce55-4154-89fc-c1c6051bb52d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.164632 May 12 19:05:10.207542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 337/688] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:10 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:11.110301 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-ccad2ec5-2f0c-43a1-8af6-667d63cd1ba5 req-c4dd809a-f1e9-455d-8161-94c933832544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ff207-805c-42db-9da8-6e493ecdd78e", "name": "network-vif-plugged", "status": "completed", "tag": "d6ee4e3b-c3f4-4c30-877e-37f58454c827"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:11.119133 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ccad2ec5-2f0c-43a1-8af6-667d63cd1ba5 req-c4dd809a-f1e9-455d-8161-94c933832544 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:11.119474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ccad2ec5-2f0c-43a1-8af6-667d63cd1ba5 req-c4dd809a-f1e9-455d-8161-94c933832544 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:11.132824 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-ccad2ec5-2f0c-43a1-8af6-667d63cd1ba5 req-c4dd809a-f1e9-455d-8161-94c933832544 service nova] Creating event network-vif-plugged:d6ee4e3b-c3f4-4c30-877e-37f58454c827 for instance 651ff207-805c-42db-9da8-6e493ecdd78e on hv-cinder-79575 May 12 19:05:11.139478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-ccad2ec5-2f0c-43a1-8af6-667d63cd1ba5 req-c4dd809a-f1e9-455d-8161-94c933832544 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164024 May 12 19:05:11.140345 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 352/689] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:11.143646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3915b049-b93b-433c-a3f2-2b9dcd47d310 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:11.144651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3915b049-b93b-433c-a3f2-2b9dcd47d310 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:11.151736 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3915b049-b93b-433c-a3f2-2b9dcd47d310 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:11.152188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3915b049-b93b-433c-a3f2-2b9dcd47d310 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:11.152959 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3915b049-b93b-433c-a3f2-2b9dcd47d310 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:11.153415 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3915b049-b93b-433c-a3f2-2b9dcd47d310 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:11.188811 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3915b049-b93b-433c-a3f2-2b9dcd47d310 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048720 May 12 19:05:11.193215 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 338/690] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:11 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:05:11.226146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:11.227041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:11.233509 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:11.234095 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:11.234978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:11.235511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:11.683755 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:11.691513 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:11.693017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:11.694202 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-79910040-84e0-4037-a17e-9710b969c6c9 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.472553 May 12 19:05:11.695206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 353/691] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:11 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:12.200732 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8a9cb385-4dc6-4988-9ab2-5147ce43024d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:12.201712 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8a9cb385-4dc6-4988-9ab2-5147ce43024d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:12.208904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a9cb385-4dc6-4988-9ab2-5147ce43024d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:12.208904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a9cb385-4dc6-4988-9ab2-5147ce43024d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:12.209652 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a9cb385-4dc6-4988-9ab2-5147ce43024d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:12.210089 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a9cb385-4dc6-4988-9ab2-5147ce43024d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:12.240189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8a9cb385-4dc6-4988-9ab2-5147ce43024d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 May 12 19:05:12.240762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 339/692] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:12 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:12.713549 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:12.714245 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:12.720981 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:12.721426 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:12.722215 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:12.722699 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:12.869614 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:12.877933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:12.879537 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:12.880718 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-879f981e-591f-4fc9-9f03-8321de9af8f8 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1732 microversion: 2.20 time: 0.171603 May 12 19:05:12.881279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 354/693] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:12 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 19:05:13.252502 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bb5bde17-5257-42b5-9dac-c9daf092517f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:13.254030 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bb5bde17-5257-42b5-9dac-c9daf092517f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:13.261195 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bb5bde17-5257-42b5-9dac-c9daf092517f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:13.261668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bb5bde17-5257-42b5-9dac-c9daf092517f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:13.262639 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bb5bde17-5257-42b5-9dac-c9daf092517f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:13.263075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bb5bde17-5257-42b5-9dac-c9daf092517f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:13.294254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bb5bde17-5257-42b5-9dac-c9daf092517f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 May 12 19:05:13.294834 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 340/694] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:13 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:13.900416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:13.901040 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:13.907753 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:13.908212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:13.908989 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:13.909432 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:14.035393 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:14.043309 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:14.044808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:14.045996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-99229d17-e1db-486c-8dc5-f99d4ac15747 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1719 microversion: 2.20 time: 0.149692 May 12 19:05:14.046554 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 355/695] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:13 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:14.305826 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-50f3ed0b-92bb-4324-bdcf-7faa28ae1f4f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:14.306790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-50f3ed0b-92bb-4324-bdcf-7faa28ae1f4f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:14.312989 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-50f3ed0b-92bb-4324-bdcf-7faa28ae1f4f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:14.313434 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-50f3ed0b-92bb-4324-bdcf-7faa28ae1f4f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:14.314230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-50f3ed0b-92bb-4324-bdcf-7faa28ae1f4f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:14.314663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-50f3ed0b-92bb-4324-bdcf-7faa28ae1f4f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:14.345790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-50f3ed0b-92bb-4324-bdcf-7faa28ae1f4f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 May 12 19:05:14.346350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 341/696] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:14 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:14.657577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-af22c66f-a5a6-47b9-96fe-e38cdee07aab tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:14.658495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-af22c66f-a5a6-47b9-96fe-e38cdee07aab tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:14.664449 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af22c66f-a5a6-47b9-96fe-e38cdee07aab tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:14.665077 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af22c66f-a5a6-47b9-96fe-e38cdee07aab tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:14.665865 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af22c66f-a5a6-47b9-96fe-e38cdee07aab tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:14.666863 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af22c66f-a5a6-47b9-96fe-e38cdee07aab tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:14.700468 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-af22c66f-a5a6-47b9-96fe-e38cdee07aab tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047413 May 12 19:05:14.701053 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 356/697] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:14 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:14.714885 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-16bb1917-7a76-4006-acc7-ccde3f4e392e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:14.715415 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-16bb1917-7a76-4006-acc7-ccde3f4e392e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:14.721847 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16bb1917-7a76-4006-acc7-ccde3f4e392e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:14.722398 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16bb1917-7a76-4006-acc7-ccde3f4e392e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:14.723177 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16bb1917-7a76-4006-acc7-ccde3f4e392e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:14.723613 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-16bb1917-7a76-4006-acc7-ccde3f4e392e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:14.752623 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-16bb1917-7a76-4006-acc7-ccde3f4e392e tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/582dc61b-414b-4801-8e79-fce9194940df" status: 200 len: 194 microversion: 2.1 time: 0.042895 May 12 19:05:14.753236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 342/698] 10.222.0.48 () {58 vars in 1412 bytes} [Thu May 12 19:05:14 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/582dc61b-414b-4801-8e79-fce9194940df => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:15.356407 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7c96c073-ee7e-4075-8a17-16b6c735dd34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:15.357262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7c96c073-ee7e-4075-8a17-16b6c735dd34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:15.363653 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c96c073-ee7e-4075-8a17-16b6c735dd34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:15.364106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c96c073-ee7e-4075-8a17-16b6c735dd34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:15.364869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c96c073-ee7e-4075-8a17-16b6c735dd34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:15.365306 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c96c073-ee7e-4075-8a17-16b6c735dd34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:15.394597 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7c96c073-ee7e-4075-8a17-16b6c735dd34 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042057 May 12 19:05:15.395524 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 357/699] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:15 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:05:15.451920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:15.452552 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:15.458705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:15.459162 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:15.459938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:15.460382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:15.492871 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:05:15.567976 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3ec1a709-fe23-4686-8cc8-ca34d84f2897 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 204 len: 0 microversion: 2.1 time: 0.119909 May 12 19:05:15.568891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 343/700] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:15 2022] DELETE /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:05:15.577205 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:15.577859 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:15.583730 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:15.584179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:15.584933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:15.585363 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:15.708798 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:15.716834 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4458046f-5b40-4fc5-b5a4-2e5b39a548a0 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1681 microversion: 2.1 time: 0.143374 May 12 19:05:15.717647 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 358/701] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:15 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:16.090812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9642cef2-729a-4d2f-b5a6-0d3b22d49fae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44065a08-d50b-46ab-9d04-ff5af48b8428"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:16.091954 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9642cef2-729a-4d2f-b5a6-0d3b22d49fae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:16.097636 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9642cef2-729a-4d2f-b5a6-0d3b22d49fae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:16.098085 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9642cef2-729a-4d2f-b5a6-0d3b22d49fae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:16.098842 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9642cef2-729a-4d2f-b5a6-0d3b22d49fae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:16.099333 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9642cef2-729a-4d2f-b5a6-0d3b22d49fae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:16.734212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:16.735402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:16.741732 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:16.742193 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:16.742996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:16.743434 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:16.879888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:16.890685 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d2b84ef5-b652-4e99-8003-6057b8baf29d tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1681 microversion: 2.1 time: 0.160188 May 12 19:05:16.891529 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 359/702] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:16 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:17.024044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9642cef2-729a-4d2f-b5a6-0d3b22d49fae tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "POST /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.937899 May 12 19:05:17.024825 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 344/703] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:05:16 2022] POST /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:17.907560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:17.908198 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:17.914513 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:17.915032 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:17.915721 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:17.916173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:18.004610 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ebd0110fff4620b11e881c90470cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1579004868f04df3baa3ad959277ba00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:18.012266 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1b437fb5-c03d-4d58-a206-982b7741154e tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 200 len: 1613 microversion: 2.1 time: 0.108860 May 12 19:05:18.013149 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 360/704] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:17 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 1613 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:18.478340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-2e8a8278-b5f9-48ac-88a7-0fc70ed2af47 req-0687b2b3-a73a-4ead-8b94-28399e320863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e0320c-b957-4332-9135-008d05fe800d", "name": "network-vif-deleted", "tag": "90e7efaf-e7a7-4ba1-b899-4974cb0deb3d"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:18.488715 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-2e8a8278-b5f9-48ac-88a7-0fc70ed2af47 req-0687b2b3-a73a-4ead-8b94-28399e320863 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:18.489162 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-2e8a8278-b5f9-48ac-88a7-0fc70ed2af47 req-0687b2b3-a73a-4ead-8b94-28399e320863 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:18.502405 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-2e8a8278-b5f9-48ac-88a7-0fc70ed2af47 req-0687b2b3-a73a-4ead-8b94-28399e320863 service nova] Creating event network-vif-deleted:90e7efaf-e7a7-4ba1-b899-4974cb0deb3d for instance 22e0320c-b957-4332-9135-008d05fe800d on hv-cinder-79575 May 12 19:05:18.507541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-2e8a8278-b5f9-48ac-88a7-0fc70ed2af47 req-0687b2b3-a73a-4ead-8b94-28399e320863 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202013 May 12 19:05:18.509054 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 345/705] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:05:19.030145 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:19.031621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:19.038635 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:19.039161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:19.039939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:19.040372 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:19.054763 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d HTTP/1.1 May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:19.056950 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:19.058464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '22e0320c-b957-4332-9135-008d05fe800d'} May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:19.059201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:19.060502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:19.062905 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:19.063821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-04c454b2-17bf-4edd-9b44-97b65689f944 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 404 len: 111 microversion: 2.1 time: 0.037822 May 12 19:05:19.067659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 361/706] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:19 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:19.073789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3bf59924-db2e-4804-bc67-4c54d4ebcb40 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '.version_select at 0x7f38c76f4f70>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:19.093285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3bf59924-db2e-4804-bc67-4c54d4ebcb40 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556244412" status: 202 len: 0 microversion: 2.1 time: 0.024075 May 12 19:05:19.094263 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 346/707] 10.222.0.48 () {58 vars in 1220 bytes} [Thu May 12 19:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556244412 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:05:21.307461 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:21.307949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:21.314338 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:21.314794 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:21.315570 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:21.316012 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:21.330051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d HTTP/1.1 May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:21.331837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.333214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '22e0320c-b957-4332-9135-008d05fe800d'} May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:21.333967 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.335112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:21.336596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:21.336596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f5bde65c-6c39-4cbe-b54f-243209b8300f tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 404 len: 111 microversion: 2.1 time: 0.030141 May 12 19:05:21.336596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 362/708] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:21 2022] DELETE /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 19:05:21.342837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:21.343571 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 22e0320c-b957-4332-9135-008d05fe800d] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:21.351535 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:21.351983 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:21.352762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:21.353792 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:21.366792 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d HTTP/1.1 May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:21.368413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.370400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '22e0320c-b957-4332-9135-008d05fe800d'} May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:21.371303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. May 12 19:05:21.372722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:21.374164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 22e0320c-b957-4332-9135-008d05fe800d could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:21.374164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b5a47115-bad5-445e-8e9f-564587c668cb tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d" status: 404 len: 111 microversion: 2.1 time: 0.030900 May 12 19:05:21.374164 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 347/709] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:21 2022] GET /compute/v2.1/servers/22e0320c-b957-4332-9135-008d05fe800d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:21.854768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1212300817", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "networks": [{"uuid": "1d8085cc-1192-4116-963e-31bacb176555"}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:21.906336 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] validate_networks() for [('1d8085cc-1192-4116-963e-31bacb176555', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:05:22.292797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:05:22.293225 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:05:22.293754 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:05:22.294176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:05:22.294597 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:05:22.303028 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.303478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.304288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.304732 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.322420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Getting quotas for project 69299e9979554ba2b07a5e29d1b792b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:05:22.326313 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Getting quotas for user 4afe3e5522534562ad835af83b830ab9 and project 69299e9979554ba2b07a5e29d1b792b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:05:22.337019 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:05:22.339303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:05:22.383462 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0ec6b844-1d9c-4634-a0fb-b986e02ed105 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532834 May 12 19:05:22.384114 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 363/710] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:05:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:05:22.394485 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-06e3195a-97ee-46ea-a998-9fbb5edee8fb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:22.395103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-06e3195a-97ee-46ea-a998-9fbb5edee8fb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:22.452400 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-06e3195a-97ee-46ea-a998-9fbb5edee8fb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:22.459026 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-06e3195a-97ee-46ea-a998-9fbb5edee8fb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1214 microversion: 2.1 time: 0.068204 May 12 19:05:22.459472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 348/711] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:22 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:22.500778 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:22.501282 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:22.507929 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.508496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.509281 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.509712 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.523176 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 HTTP/1.1 May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:22.525009 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.526631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '87951282-3c6e-4899-9775-022278e4bfa8'} May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:22.527358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.528622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.530367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:22.530367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ce250c65-385c-421b-b478-a72bc2566513 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 404 len: 111 microversion: 2.1 time: 0.030245 May 12 19:05:22.530367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 364/712] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:22 2022] DELETE /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:22.535633 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:22.536252 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 87951282-3c6e-4899-9775-022278e4bfa8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:22.543438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.543824 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.544585 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.545022 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.559009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 HTTP/1.1 May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:22.560607 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.562071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '87951282-3c6e-4899-9775-022278e4bfa8'} May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:22.562809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. May 12 19:05:22.564018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.565053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 87951282-3c6e-4899-9775-022278e4bfa8 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:22.565053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e35b4259-e959-4f9c-86f7-99533a3646cf tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8" status: 404 len: 111 microversion: 2.1 time: 0.030257 May 12 19:05:22.565053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 349/713] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:22 2022] GET /compute/v2.1/servers/87951282-3c6e-4899-9775-022278e4bfa8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:22.571278 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:22.572369 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:22.578199 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.578654 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.579430 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.579897 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.595072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f HTTP/1.1 May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:22.596768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.598498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '29b7344e-55ce-4f61-9c68-6473e53a5d9f'} May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:22.599814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.601004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:22.602731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:22.602731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-050617a3-6c04-4be5-a988-0a5942477da2 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 404 len: 111 microversion: 2.1 time: 0.031310 May 12 19:05:22.602731 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 365/714] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:22 2022] DELETE /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:22.606674 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:22.607285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 29b7344e-55ce-4f61-9c68-6473e53a5d9f] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:22.613516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.613692 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.614398 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:22.614829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:22.629779 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f HTTP/1.1 May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:22.631284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.632938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '29b7344e-55ce-4f61-9c68-6473e53a5d9f'} May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:22.634857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. May 12 19:05:22.636088 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:22.637289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 29b7344e-55ce-4f61-9c68-6473e53a5d9f could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:22.637289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c110363e-5595-48a2-bccf-6efd69f34454 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f" status: 404 len: 111 microversion: 2.1 time: 0.029843 May 12 19:05:22.637289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 350/715] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:22 2022] GET /compute/v2.1/servers/29b7344e-55ce-4f61-9c68-6473e53a5d9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:23.475845 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:23.476467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:23.483423 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:23.483814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:23.485428 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:23.485939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:23.549667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:23.559180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3e19bb48-900a-4cfe-9263-f5a5a63f6b43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1210 microversion: 2.1 time: 0.087087 May 12 19:05:23.560096 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 366/716] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:23 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:23.785166 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:23.785695 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:23.791925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:23.792369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:23.793128 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:23.793600 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:23.807046 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: DELETE /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 HTTP/1.1 May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:23.808556 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.810107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '64bcf7c1-c1cd-4149-af79-39ad90968742'} May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:23.810912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.812259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:23.813661 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:23.813661 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-07b47c65-e7df-4c31-84e1-fc852633fc42 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 404 len: 111 microversion: 2.1 time: 0.028494 May 12 19:05:23.813661 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 351/717] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:23 2022] DELETE /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:23.818358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:23.819008 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] [instance: 64bcf7c1-c1cd-4149-af79-39ad90968742] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:23.827198 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:23.827651 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:23.828417 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:23.828856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:23.841670 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] HTTP exception thrown: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Request method failure captured: May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 HTTP/1.1 May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkVzvW7iIKRf1Lm48Xu4LbpdI-weJRJR7dfsHM3ynCXCiaPFeOM5odGac7aEiE9AcloiwoEpAvYw0CEyWFNTfdDeQTZzuCw0_xGr0vgOM776_-SkK7pClkE4lpA7Ib09RI3m1TWBRrJIQnePAJLFqmPFIx1nwoqRZyIblppZQzl1fM May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:23.843170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1579004868f04df3baa3ad959277ba00", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1579004868f04df3baa3ad959277ba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1579004868f04df3baa3ad959277ba00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 1579004868f04df3baa3ad959277ba00 May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1557278315 May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: e1ebd0110fff4620b11e881c90470cda May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeNegativeTest-1557278315-project May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.844605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '64bcf7c1-c1cd-4149-af79-39ad90968742'} May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:23.845888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. May 12 19:05:23.847413 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:23.848652 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] Returning 404 to user: Instance 64bcf7c1-c1cd-4149-af79-39ad90968742 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:23.848652 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7234fdec-2ca6-4490-b2f3-288a26bc6623 tempest-AttachVolumeNegativeTest-1557278315 tempest-AttachVolumeNegativeTest-1557278315-project] 10.222.0.48 "GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742" status: 404 len: 111 microversion: 2.1 time: 0.029978 May 12 19:05:23.848652 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 367/718] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:23 2022] GET /compute/v2.1/servers/64bcf7c1-c1cd-4149-af79-39ad90968742 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:24.539629 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d67606ee-0a24-4a82-8ff0-cf4ea2ed9aaf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:24.540990 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d67606ee-0a24-4a82-8ff0-cf4ea2ed9aaf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:24.547130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d67606ee-0a24-4a82-8ff0-cf4ea2ed9aaf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.547670 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d67606ee-0a24-4a82-8ff0-cf4ea2ed9aaf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.548518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d67606ee-0a24-4a82-8ff0-cf4ea2ed9aaf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.549023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d67606ee-0a24-4a82-8ff0-cf4ea2ed9aaf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.576799 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:24.577444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:24.583991 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.584434 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d67606ee-0a24-4a82-8ff0-cf4ea2ed9aaf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049146 May 12 19:05:24.584577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.585195 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 352/719] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:24 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:24.585308 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.585740 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.660766 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:24.668385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-56644f30-fec0-4751-a1e2-a18469e0c47b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1266 microversion: 2.1 time: 0.095565 May 12 19:05:24.668954 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 368/720] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:24 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:24.683554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-96b58c94-714e-405f-8a29-fb3c7cad3ba3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:24.684047 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-96b58c94-714e-405f-8a29-fb3c7cad3ba3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:24.689894 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-96b58c94-714e-405f-8a29-fb3c7cad3ba3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.690343 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-96b58c94-714e-405f-8a29-fb3c7cad3ba3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.691103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-96b58c94-714e-405f-8a29-fb3c7cad3ba3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.691532 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-96b58c94-714e-405f-8a29-fb3c7cad3ba3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.720890 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-96b58c94-714e-405f-8a29-fb3c7cad3ba3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/582dc61b-414b-4801-8e79-fce9194940df" status: 200 len: 194 microversion: 2.1 time: 0.041825 May 12 19:05:24.721495 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 353/721] 10.222.0.48 () {58 vars in 1412 bytes} [Thu May 12 19:05:24 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/582dc61b-414b-4801-8e79-fce9194940df => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:24.732311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:24.732845 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:24.739260 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.739697 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.740511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:24.740957 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:24.824588 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lazy-loading 'services' on Instance uuid 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:05:24.931670 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-452e89d1-36ca-4c5d-a644-5c67d3de07cf tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/582dc61b-414b-4801-8e79-fce9194940df" status: 202 len: 0 microversion: 2.1 time: 0.203112 May 12 19:05:24.932612 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 369/722] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:05:24 2022] DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/582dc61b-414b-4801-8e79-fce9194940df => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:05:25.685839 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:25.686446 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:25.692878 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:25.693321 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:25.694119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:25.694546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:25.781951 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:25.789251 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-00afacd8-4d88-48c1-88c7-5314826be363 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1272 microversion: 2.1 time: 0.107199 May 12 19:05:25.789840 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 354/723] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:25 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:26.811520 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:26.812294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:26.818884 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:26.819334 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:26.820242 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:26.820820 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:27.187454 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:27.200119 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a9ec36d0-3d70-45bb-a879-8007d7f71014 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1314 microversion: 2.1 time: 0.395812 May 12 19:05:27.205641 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 370/724] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:26 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:27.235005 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2c29b575-2307-4264-96ae-10caab8016e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:27.235652 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2c29b575-2307-4264-96ae-10caab8016e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:27.244841 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c29b575-2307-4264-96ae-10caab8016e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:27.245425 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c29b575-2307-4264-96ae-10caab8016e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:27.246344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c29b575-2307-4264-96ae-10caab8016e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:27.246882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c29b575-2307-4264-96ae-10caab8016e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:27.281052 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2c29b575-2307-4264-96ae-10caab8016e3 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/44065a08-d50b-46ab-9d04-ff5af48b8428" status: 200 len: 194 microversion: 2.1 time: 0.056544 May 12 19:05:27.293359 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:27.293994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:27.297882 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 355/725] 10.222.0.48 () {58 vars in 1412 bytes} [Thu May 12 19:05:27 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/44065a08-d50b-46ab-9d04-ff5af48b8428 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:27.308708 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:27.309426 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:27.310259 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:27.310705 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:27.410571 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lazy-loading 'services' on Instance uuid 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:05:27.511466 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8ee59198-d1cf-4058-bf03-bc8088d51211 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/44065a08-d50b-46ab-9d04-ff5af48b8428" status: 202 len: 0 microversion: 2.1 time: 0.220720 May 12 19:05:27.515551 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 371/726] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:05:27 2022] DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments/44065a08-d50b-46ab-9d04-ff5af48b8428 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:05:27.662350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-594c1e1c-6a46-4375-a0fa-b560459d7363 req-9477ef23-f5e9-47b5-b708-04add4ed27f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2298bf22-a0d8-4b01-b0de-7bb726405894", "tag": "265b9362-9c57-48ae-9a5f-94fca24150f1"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:27.681267 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-594c1e1c-6a46-4375-a0fa-b560459d7363 req-9477ef23-f5e9-47b5-b708-04add4ed27f2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:27.687169 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-594c1e1c-6a46-4375-a0fa-b560459d7363 req-9477ef23-f5e9-47b5-b708-04add4ed27f2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:27.718139 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-594c1e1c-6a46-4375-a0fa-b560459d7363 req-9477ef23-f5e9-47b5-b708-04add4ed27f2 service nova] Creating event network-changed:265b9362-9c57-48ae-9a5f-94fca24150f1 for instance 2298bf22-a0d8-4b01-b0de-7bb726405894 on hv-cinder-79575 May 12 19:05:27.731525 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-594c1e1c-6a46-4375-a0fa-b560459d7363 req-9477ef23-f5e9-47b5-b708-04add4ed27f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072808 May 12 19:05:27.732459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 356/727] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:28.217682 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:28.218706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:28.226027 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:28.226581 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:28.227657 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:28.228660 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:28.447627 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:28.455749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-53197b17-fdd9-412e-a9ac-88ba8bef7591 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1314 microversion: 2.1 time: 0.242263 May 12 19:05:28.465869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 372/728] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:28 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:28.760050 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d8d03df2-e9d9-4ada-b0ec-f3b3ac34b34a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:28.761118 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d8d03df2-e9d9-4ada-b0ec-f3b3ac34b34a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:28.767553 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8d03df2-e9d9-4ada-b0ec-f3b3ac34b34a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:28.767991 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8d03df2-e9d9-4ada-b0ec-f3b3ac34b34a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:28.768751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8d03df2-e9d9-4ada-b0ec-f3b3ac34b34a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:28.769181 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d8d03df2-e9d9-4ada-b0ec-f3b3ac34b34a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:28.799343 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d8d03df2-e9d9-4ada-b0ec-f3b3ac34b34a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044240 May 12 19:05:28.799862 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 357/729] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:28 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:05:28.904442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4eb37550-ba73-4682-a1b2-d7a7afe7769c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:28.905736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4eb37550-ba73-4682-a1b2-d7a7afe7769c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:28.911648 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4eb37550-ba73-4682-a1b2-d7a7afe7769c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:28.912091 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4eb37550-ba73-4682-a1b2-d7a7afe7769c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:28.912850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4eb37550-ba73-4682-a1b2-d7a7afe7769c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:28.913278 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4eb37550-ba73-4682-a1b2-d7a7afe7769c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:28.942689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4eb37550-ba73-4682-a1b2-d7a7afe7769c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042125 May 12 19:05:28.943444 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 373/730] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:05:28 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:05:29.005068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:29.005589 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:29.011820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:29.012270 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:29.013231 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:29.013979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:29.040043 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:05:29.132255 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-14c2a262-7a16-4e46-b240-03aa559e6d64 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 204 len: 0 microversion: 2.1 time: 0.130687 May 12 19:05:29.132846 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 358/731] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:29 2022] DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:05:29.141737 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:29.142388 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:29.148350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:29.148855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:29.149747 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:29.150186 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:29.282766 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:29.290620 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6778fd42-3d64-440e-860d-80ebbe26f30c tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1674 microversion: 2.1 time: 0.152521 May 12 19:05:29.291191 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 374/732] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:29 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:29.472617 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:29.473798 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:29.481554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:29.482260 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:29.483211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:29.484009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:29.626397 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:29.633602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5662e789-9245-43bc-bca5-0a3b02c1bbda tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1314 microversion: 2.1 time: 0.165172 May 12 19:05:29.634230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 359/733] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:29 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:30.307749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:30.308388 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:30.314765 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:30.315212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:30.315980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:30.316419 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:30.443899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:30.451808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6f83d88e-41cb-4fd2-b3de-983481a4ae95 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1674 microversion: 2.1 time: 0.147890 May 12 19:05:30.452379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 375/734] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:30 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:30.616743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ae68d113-161d-48dd-9226-3d2f90efbeb2 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c7702430>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:30.652071 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:30.652774 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:30.658938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:30.659457 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:30.660340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:30.660836 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:30.663437 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ae68d113-161d-48dd-9226-3d2f90efbeb2 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5b3f507-ecf5-4762-a433-08fe6faea03e" status: 200 len: 350 microversion: 2.1 time: 0.050414 May 12 19:05:30.664039 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 360/735] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:05:30 2022] GET /compute/v2.1/os-volumes/a5b3f507-ecf5-4762-a433-08fe6faea03e => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:30.794667 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:30.802617 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d7885988-5f73-4e20-9d65-c7a2d408618a tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1314 microversion: 2.1 time: 0.155550 May 12 19:05:30.803717 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 376/736] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:30 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:31.468228 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:31.469135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:31.475055 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:31.475735 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:31.476502 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:31.476936 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:31.792077 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:31.799472 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dce2203a-d830-49f1-bb48-8ce7dd6f3060 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1674 microversion: 2.1 time: 0.335031 May 12 19:05:31.799966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 361/737] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:31 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1674 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:31.819585 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:31.820236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:31.826545 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:31.826997 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:31.827802 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:31.828239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:31.981886 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9898336c-e2a1-4565-933f-97bdcebc751d tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c7702040>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:32.028514 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9898336c-e2a1-4565-933f-97bdcebc751d tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4b156c0e-99f2-4567-9664-66e8efcb9bfa" status: 200 len: 350 microversion: 2.1 time: 0.050318 May 12 19:05:32.029751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 362/738] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:05:31 2022] GET /compute/v2.1/os-volumes/4b156c0e-99f2-4567-9664-66e8efcb9bfa => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:05:32.048297 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:32.056265 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6f6a38e5-2469-4ec0-81e3-0990a815f80b tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1314 microversion: 2.1 time: 0.239811 May 12 19:05:32.056768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 377/739] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:31 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:32.816868 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:32.817489 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:32.824509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:32.824902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:32.825721 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:32.826169 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:32.922293 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-fdf2959b-48a6-410b-a623-6c86d5eac673 req-29e7b351-f7c4-4485-a80a-b0c22a4a1911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d9a1db-4ae5-4e5d-bc0f-eae936fc362c", "name": "network-vif-deleted", "tag": "5e762846-9002-4df1-9a78-c923c3f1fc21"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:32.923159 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c202a7f2c484cd3b0363b75c1a673a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61f3c6e7974486a9f3a4f9d361c5fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:32.932925 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-fdf2959b-48a6-410b-a623-6c86d5eac673 req-29e7b351-f7c4-4485-a80a-b0c22a4a1911 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:32.933954 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-fdf2959b-48a6-410b-a623-6c86d5eac673 req-29e7b351-f7c4-4485-a80a-b0c22a4a1911 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:32.936289 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2bdd71ac-9735-42fa-b3b2-59e69a875f92 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 200 len: 1607 microversion: 2.1 time: 0.123668 May 12 19:05:32.938049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 363/740] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:32 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 1607 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:32.947695 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-fdf2959b-48a6-410b-a623-6c86d5eac673 req-29e7b351-f7c4-4485-a80a-b0c22a4a1911 service nova] Creating event network-vif-deleted:5e762846-9002-4df1-9a78-c923c3f1fc21 for instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c on hv-cinder-79575 May 12 19:05:32.952859 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-fdf2959b-48a6-410b-a623-6c86d5eac673 req-29e7b351-f7c4-4485-a80a-b0c22a4a1911 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035077 May 12 19:05:32.953878 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 378/741] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:05:33.074004 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.075087 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:33.082094 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:33.082696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:33.083715 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:33.084250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:33.174938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-385ad369-6fb3-42d6-9f3a-18082a218c69 req-272ed050-0f8d-4b65-91c2-5df5d24bdea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2298bf22-a0d8-4b01-b0de-7bb726405894", "name": "network-vif-plugged", "status": "completed", "tag": "265b9362-9c57-48ae-9a5f-94fca24150f1"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:33.189163 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-385ad369-6fb3-42d6-9f3a-18082a218c69 req-272ed050-0f8d-4b65-91c2-5df5d24bdea6 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:33.190092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-385ad369-6fb3-42d6-9f3a-18082a218c69 req-272ed050-0f8d-4b65-91c2-5df5d24bdea6 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:33.202540 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-385ad369-6fb3-42d6-9f3a-18082a218c69 req-272ed050-0f8d-4b65-91c2-5df5d24bdea6 service nova] Creating event network-vif-plugged:265b9362-9c57-48ae-9a5f-94fca24150f1 for instance 2298bf22-a0d8-4b01-b0de-7bb726405894 on hv-cinder-79575 May 12 19:05:33.210030 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-385ad369-6fb3-42d6-9f3a-18082a218c69 req-272ed050-0f8d-4b65-91c2-5df5d24bdea6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041849 May 12 19:05:33.211501 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 379/742] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:33.235562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:33.242906 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bc6a4ffb-fb14-4de6-b0d6-a45da18deb0e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1314 microversion: 2.1 time: 0.173606 May 12 19:05:33.243524 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 364/743] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:33.365186 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-14b1ff85-ce6a-464c-8f05-280886fe79dd tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c2340ee0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.417686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-14b1ff85-ce6a-464c-8f05-280886fe79dd tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/fac57050-7e69-4dae-98b2-cbd81492ed3d" status: 200 len: 351 microversion: 2.1 time: 0.056661 May 12 19:05:33.418257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 380/744] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/os-volumes/fac57050-7e69-4dae-98b2-cbd81492ed3d => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:33.429457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b09c6013-6fa3-4da9-a790-1d723eccfc83 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c2368160>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.523545 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b09c6013-6fa3-4da9-a790-1d723eccfc83 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097950 May 12 19:05:33.525307 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 365/745] 10.222.0.48 () {58 vars in 1133 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:33.538393 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6a88d1a0-4a0a-4ed9-8d93-d5827b0a24c2 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c23fdaf0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.619732 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6a88d1a0-4a0a-4ed9-8d93-d5827b0a24c2 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085223 May 12 19:05:33.620427 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 381/746] 10.222.0.48 () {58 vars in 1148 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:33.632173 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8995a1d6-9849-4467-bec9-c12e52f9b72e tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c76bc550>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.712220 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8995a1d6-9849-4467-bec9-c12e52f9b72e tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083881 May 12 19:05:33.712788 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 366/747] 10.222.0.48 () {58 vars in 1133 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:33.724694 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bbee8813-f57f-45d4-a992-f558e7105cd8 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c2361310>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.805006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bbee8813-f57f-45d4-a992-f558e7105cd8 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084543 May 12 19:05:33.805688 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 382/748] 10.222.0.48 () {58 vars in 1166 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:33.818007 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-de582bdf-47aa-4b0f-8761-6254f0b07f5e tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c769e4c0>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.907789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-de582bdf-47aa-4b0f-8761-6254f0b07f5e tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093761 May 12 19:05:33.908258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 367/749] 10.222.0.48 () {58 vars in 1169 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:33.920051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-56491410-f5f8-4eaa-9c3b-1c66c69cddf8 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c23a40d0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.955473 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:33.956218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:33.963293 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:33.963866 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:33.964748 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:33.965292 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:33.978905 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] HTTP exception thrown: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Request method failure captured: May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c HTTP/1.1 May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkO67neL0xgcWgkaOBSLhwF25pb2hs35yXSZ6_Hd8A13uioXb8O4sJwPi7Ishb7eJNrexJ5_sbtgB2ODlM0aqI-SdLuPntZ-Dy14UacNABBxwzBUXFFT_UNi2r8kkQqSgG5gwGD5l1OrsQyqE--EYcaCR8gH2_BZTgI-yn9j_Lfwig May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:33.980682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a61f3c6e7974486a9f3a4f9d361c5fb6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 2c202a7f2c484cd3b0363b75c1a673a3 May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:33.982304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '15d9a1db-4ae5-4e5d-bc0f-eae936fc362c'} May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:33.983464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:33.984932 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:33.986304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Returning 404 to user: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:33.986304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-78b8f656-4235-4302-9284-55ee3581402f tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 404 len: 111 microversion: 2.1 time: 0.031918 May 12 19:05:33.987987 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 368/750] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 19:05:33.992812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9cd9b737-a112-4e4a-adf9-b2b922f078be tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '.version_select at 0x7f38c7702670>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:34.000972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-56491410-f5f8-4eaa-9c3b-1c66c69cddf8 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084654 May 12 19:05:34.005558 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 383/751] 10.222.0.48 () {58 vars in 1154 bytes} [Thu May 12 19:05:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:34.011275 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9cd9b737-a112-4e4a-adf9-b2b922f078be tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974088322" status: 202 len: 0 microversion: 2.1 time: 0.022161 May 12 19:05:34.011852 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 369/752] 10.222.0.48 () {58 vars in 1220 bytes} [Thu May 12 19:05:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974088322 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:05:34.013548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f0ffa44c-76e0-4b3f-84a0-320f648ff22e tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c2340820>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:34.094975 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f0ffa44c-76e0-4b3f-84a0-320f648ff22e tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085439 May 12 19:05:34.095534 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 384/753] 10.222.0.48 () {58 vars in 1187 bytes} [Thu May 12 19:05:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:34.108155 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-82840ace-29ec-42b6-ba8f-96ebf4602da1 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] Calling method '.version_select at 0x7f38c76f4430>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:34.260615 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:34.261674 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:34.269772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:34.270223 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:34.271222 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:34.271822 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:34.388831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-82840ace-29ec-42b6-ba8f-96ebf4602da1 tempest-VolumesTestJSON-2135179765 tempest-VolumesTestJSON-2135179765-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.284468 May 12 19:05:34.389570 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 370/754] 10.222.0.48 () {58 vars in 1154 bytes} [Thu May 12 19:05:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:34.444094 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:34.452376 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-659051a1-9c77-4947-97f6-02bfca3654f8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1314 microversion: 2.1 time: 0.196300 May 12 19:05:34.453402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 385/755] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:34 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:35.469716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:35.470318 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:35.477541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:35.478001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:35.478763 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:35.479198 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:35.615583 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:35.622872 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-99a7722e-ac52-4fd9-a30f-c8efa2908c43 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1496 microversion: 2.1 time: 0.157484 May 12 19:05:35.623685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 371/756] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:35 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:36.296657 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:36.297185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:36.303684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:36.304143 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:36.304918 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:36.305358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:36.331076 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:05:36.405853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f2778646-5d3e-450f-8015-b279f7c2c76c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 204 len: 0 microversion: 2.1 time: 0.112392 May 12 19:05:36.406399 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 386/757] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:36 2022] DELETE /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:05:36.414783 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:36.415403 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:36.421483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:36.422033 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:36.422805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:36.423245 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:36.548861 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:36.556594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8b155bb5-15d5-479a-877b-b14b4ffee312 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1502 microversion: 2.1 time: 0.145736 May 12 19:05:36.557154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 372/758] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:36 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1502 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:36.965236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:36.965948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:36.971894 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:36.972351 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:36.973121 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:36.973585 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:36.987093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] HTTP exception thrown: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Request method failure captured: May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c HTTP/1.1 May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkO67neL0xgcWgkaOBSLhwF25pb2hs35yXSZ6_Hd8A13uioXb8O4sJwPi7Ishb7eJNrexJ5_sbtgB2ODlM0aqI-SdLuPntZ-Dy14UacNABBxwzBUXFFT_UNi2r8kkQqSgG5gwGD5l1OrsQyqE--EYcaCR8gH2_BZTgI-yn9j_Lfwig May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:36.988722 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a61f3c6e7974486a9f3a4f9d361c5fb6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 2c202a7f2c484cd3b0363b75c1a673a3 May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:36.990383 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '15d9a1db-4ae5-4e5d-bc0f-eae936fc362c'} May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:36.991447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:36.992976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:36.994666 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Returning 404 to user: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:36.994666 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-90d63b82-9251-48fe-9cba-1a0b1ffcd5a9 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 404 len: 111 microversion: 2.1 time: 0.029673 May 12 19:05:36.994666 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 387/759] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:36 2022] DELETE /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:36.999341 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:37.000108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:37.007381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:37.007945 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:37.009428 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:37.009895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:37.027529 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] HTTP exception thrown: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Request method failure captured: May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c HTTP/1.1 May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkO67neL0xgcWgkaOBSLhwF25pb2hs35yXSZ6_Hd8A13uioXb8O4sJwPi7Ishb7eJNrexJ5_sbtgB2ODlM0aqI-SdLuPntZ-Dy14UacNABBxwzBUXFFT_UNi2r8kkQqSgG5gwGD5l1OrsQyqE--EYcaCR8gH2_BZTgI-yn9j_Lfwig May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:37.029021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a61f3c6e7974486a9f3a4f9d361c5fb6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 2c202a7f2c484cd3b0363b75c1a673a3 May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:37.030971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '15d9a1db-4ae5-4e5d-bc0f-eae936fc362c'} May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:37.032044 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. May 12 19:05:37.033457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:37.034888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Returning 404 to user: Instance 15d9a1db-4ae5-4e5d-bc0f-eae936fc362c could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:37.034888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f0ee3ab6-e62a-4f53-b025-b9c4921b4881 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c" status: 404 len: 111 microversion: 2.1 time: 0.035623 May 12 19:05:37.034888 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 373/760] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:36 2022] GET /compute/v2.1/servers/15d9a1db-4ae5-4e5d-bc0f-eae936fc362c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:37.573925 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:37.574532 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:37.580803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:37.581252 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:37.582042 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:37.582481 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:37.717030 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:37.724874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4b7193c0-eabf-4616-b465-e9cd40ef8bfb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1502 microversion: 2.1 time: 0.154856 May 12 19:05:37.725427 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 388/761] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:37 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:38.169404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:38.172093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:38.182892 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.185304 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.186253 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.186895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.203952 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] HTTP exception thrown: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Request method failure captured: May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: DELETE /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 HTTP/1.1 May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkO67neL0xgcWgkaOBSLhwF25pb2hs35yXSZ6_Hd8A13uioXb8O4sJwPi7Ishb7eJNrexJ5_sbtgB2ODlM0aqI-SdLuPntZ-Dy14UacNABBxwzBUXFFT_UNi2r8kkQqSgG5gwGD5l1OrsQyqE--EYcaCR8gH2_BZTgI-yn9j_Lfwig May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:38.205604 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a61f3c6e7974486a9f3a4f9d361c5fb6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 2c202a7f2c484cd3b0363b75c1a673a3 May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.207379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '44b6a7d2-7257-49f6-9b8d-69d6a3909dc1'} May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:38.208276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.209817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:38.213719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Returning 404 to user: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:38.213719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5f2a9eaa-6f6d-4987-91c2-ba07eb5bbd0a tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 404 len: 111 microversion: 2.1 time: 0.045269 May 12 19:05:38.213719 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 374/762] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:38 2022] DELETE /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:38.219867 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:38.220522 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] [instance: 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:38.226645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.227679 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.228454 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.228884 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.246481 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] HTTP exception thrown: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Request method failure captured: May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 HTTP/1.1 May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkO67neL0xgcWgkaOBSLhwF25pb2hs35yXSZ6_Hd8A13uioXb8O4sJwPi7Ishb7eJNrexJ5_sbtgB2ODlM0aqI-SdLuPntZ-Dy14UacNABBxwzBUXFFT_UNi2r8kkQqSgG5gwGD5l1OrsQyqE--EYcaCR8gH2_BZTgI-yn9j_Lfwig May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:38.247452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a61f3c6e7974486a9f3a4f9d361c5fb6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a61f3c6e7974486a9f3a4f9d361c5fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: a61f3c6e7974486a9f3a4f9d361c5fb6 May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1348022541 May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 2c202a7f2c484cd3b0363b75c1a673a3 May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeTestJSON-1348022541-project May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.248978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '44b6a7d2-7257-49f6-9b8d-69d6a3909dc1'} May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:38.253623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. May 12 19:05:38.255433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:38.256745 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] Returning 404 to user: Instance 44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:38.256745 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9220cd98-23f5-4d32-9095-fd05dd3fef76 tempest-AttachVolumeTestJSON-1348022541 tempest-AttachVolumeTestJSON-1348022541-project] 10.222.0.48 "GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1" status: 404 len: 111 microversion: 2.1 time: 0.033108 May 12 19:05:38.256745 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 389/763] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:38 2022] GET /compute/v2.1/servers/44b6a7d2-7257-49f6-9b8d-69d6a3909dc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:38.534883 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-74913b0b-a6bf-4005-8234-6faaa293e12a req-f7154c50-65a5-40b1-a353-20f4fa539887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2298bf22-a0d8-4b01-b0de-7bb726405894", "name": "network-vif-deleted", "tag": "265b9362-9c57-48ae-9a5f-94fca24150f1"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:38.547195 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-74913b0b-a6bf-4005-8234-6faaa293e12a req-f7154c50-65a5-40b1-a353-20f4fa539887 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.547450 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-74913b0b-a6bf-4005-8234-6faaa293e12a req-f7154c50-65a5-40b1-a353-20f4fa539887 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.563051 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-74913b0b-a6bf-4005-8234-6faaa293e12a req-f7154c50-65a5-40b1-a353-20f4fa539887 service nova] Creating event network-vif-deleted:265b9362-9c57-48ae-9a5f-94fca24150f1 for instance 2298bf22-a0d8-4b01-b0de-7bb726405894 on hv-cinder-79575 May 12 19:05:38.573875 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-74913b0b-a6bf-4005-8234-6faaa293e12a req-f7154c50-65a5-40b1-a353-20f4fa539887 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042821 May 12 19:05:38.577889 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 375/764] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:38.742474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:38.744212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:38.750665 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.751120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.751928 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.752472 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.790212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:38.790836 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:38.791471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lazy-loading 'fault' on Instance uuid 2298bf22-a0d8-4b01-b0de-7bb726405894 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:05:38.838575 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:38.846469 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6bbc5403-3f56-41bb-bddc-744a5f3d41e8 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 200 len: 1304 microversion: 2.1 time: 0.107943 May 12 19:05:38.847449 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 390/765] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:38 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:39.863944 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:39.864668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 2298bf22-a0d8-4b01-b0de-7bb726405894] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:39.872045 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:39.872701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:39.873784 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:39.874097 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:39.888596 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] HTTP exception thrown: Instance 2298bf22-a0d8-4b01-b0de-7bb726405894 could not be found. May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Request method failure captured: May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 HTTP/1.1 May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVpwOA0kuA4AubLkMAsmedFll4ZI9u2S5Bvhysg06Snfb2Ft8o33XKYhs_fY8YYsnUbZAru6VwLVMGG1IvdzItAl3DG3SGecgLhze5kdGZjCGjc6SHMLY8pgfmf9DHuycoeEoD47mo-wyFmhdX2OLKMwDg8kTK4VSs6LrAhul8HAf0U May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 69299e9979554ba2b07a5e29d1b792b8 May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-VolumesActionsTest-1274736931 May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:05:39.891740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69299e9979554ba2b07a5e29d1b792b8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69299e9979554ba2b07a5e29d1b792b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69299e9979554ba2b07a5e29d1b792b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69299e9979554ba2b07a5e29d1b792b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-VolumesActionsTest-1274736931 May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 69299e9979554ba2b07a5e29d1b792b8 May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-VolumesActionsTest-1274736931 May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-VolumesActionsTest-1274736931-project May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 4afe3e5522534562ad835af83b830ab9 May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-VolumesActionsTest-1274736931-project May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 2298bf22-a0d8-4b01-b0de-7bb726405894 could not be found. May 12 19:05:39.893278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '2298bf22-a0d8-4b01-b0de-7bb726405894'} May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2298bf22-a0d8-4b01-b0de-7bb726405894 could not be found. May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:39.894250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2298bf22-a0d8-4b01-b0de-7bb726405894 could not be found. May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2298bf22-a0d8-4b01-b0de-7bb726405894 could not be found. May 12 19:05:39.895703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:05:39.901374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Returning 404 to user: Instance 2298bf22-a0d8-4b01-b0de-7bb726405894 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:39.901374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-01013eb7-3890-4b1e-824d-5981d44d8593 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894" status: 404 len: 111 microversion: 2.1 time: 0.033455 May 12 19:05:39.904739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 376/766] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:39 2022] GET /compute/v2.1/servers/2298bf22-a0d8-4b01-b0de-7bb726405894 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:39.996414 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2006502318", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "networks": [{"uuid": "1d8085cc-1192-4116-963e-31bacb176555"}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:40.050702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] validate_networks() for [('1d8085cc-1192-4116-963e-31bacb176555', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:05:40.475111 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:05:40.475631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:05:40.476435 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:05:40.477502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:05:40.478135 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:05:40.487070 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:40.487643 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:40.489010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:40.489450 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:40.507367 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Getting quotas for project 69299e9979554ba2b07a5e29d1b792b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:05:40.511699 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Getting quotas for user 4afe3e5522534562ad835af83b830ab9 and project 69299e9979554ba2b07a5e29d1b792b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:05:40.523899 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:05:40.526477 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:05:40.576932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-418d8630-8d28-4dfd-b5b2-48b18cc00126 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584266 May 12 19:05:40.578212 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 391/767] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 19:05:40.590215 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-555e420a-ffe3-4767-9950-b59e2cf9db41 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:40.591309 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-555e420a-ffe3-4767-9950-b59e2cf9db41 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:40.676801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-555e420a-ffe3-4767-9950-b59e2cf9db41 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:40.683884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-555e420a-ffe3-4767-9950-b59e2cf9db41 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1214 microversion: 2.1 time: 0.099072 May 12 19:05:40.684662 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 377/768] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:40 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:41.702220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:41.703526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:41.715958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:41.716900 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:41.718060 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:41.719855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:41.908115 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:41.916650 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-38b7e0db-4ca7-4c6e-86df-65c746d98acb tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1274 microversion: 2.1 time: 0.219089 May 12 19:05:41.929678 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 392/769] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:41 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1274 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:05:42.934635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:42.935923 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:42.943037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:42.944463 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:42.945250 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:42.946240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:43.156957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:43.168201 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5d2148dc-7eea-46c6-99b7-931accad2d13 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1314 microversion: 2.1 time: 0.237485 May 12 19:05:43.177408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 378/770] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:42 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:43.538803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-fecbe769-de5d-4649-a4fb-cf4f8f366645 req-a704bb44-1c16-4f7c-9408-22aa0fae3386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ad8510-aade-4207-92c7-6be143f1a70b", "tag": "1d198787-253c-4a03-a5a0-37377d7d4628"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:43.554396 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-fecbe769-de5d-4649-a4fb-cf4f8f366645 req-a704bb44-1c16-4f7c-9408-22aa0fae3386 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:43.555618 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-fecbe769-de5d-4649-a4fb-cf4f8f366645 req-a704bb44-1c16-4f7c-9408-22aa0fae3386 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:43.567325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-fecbe769-de5d-4649-a4fb-cf4f8f366645 req-a704bb44-1c16-4f7c-9408-22aa0fae3386 service nova] Creating event network-changed:1d198787-253c-4a03-a5a0-37377d7d4628 for instance 82ad8510-aade-4207-92c7-6be143f1a70b on hv-cinder-79575 May 12 19:05:43.573240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-fecbe769-de5d-4649-a4fb-cf4f8f366645 req-a704bb44-1c16-4f7c-9408-22aa0fae3386 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043419 May 12 19:05:43.574499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 393/771] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:44.186126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:44.187261 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:44.194641 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:44.195634 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:44.196488 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:44.197133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:44.364461 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:44.372548 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c56e5a50-10f2-4c5c-be3e-1abc55e84045 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1314 microversion: 2.1 time: 0.190330 May 12 19:05:44.383203 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 379/772] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:44 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:45.391213 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:45.392059 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:45.398355 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:45.398947 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:45.399743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:45.400185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:45.582058 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:45.590118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d5ce3bf5-a2d8-4582-886d-9ef290867f20 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1314 microversion: 2.1 time: 0.203504 May 12 19:05:45.590697 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 394/773] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:45 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:46.607618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:46.608241 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:46.614792 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:46.615258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:46.616042 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:46.616488 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:46.795274 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:46.803194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-46243cdb-9bbe-47aa-be91-5a15444e7ad1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1314 microversion: 2.1 time: 0.199377 May 12 19:05:46.805630 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 380/774] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:46 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:47.820374 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:47.823342 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:47.836719 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:47.837907 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:47.838898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:47.839726 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:48.023317 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:48.037715 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-eb9180ef-88c2-4ff6-9a56-205f2980be18 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1314 microversion: 2.1 time: 0.221332 May 12 19:05:48.038622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 395/775] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:47 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:49.057264 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-8b63b7c7-ad0b-42b5-ad04-6cbaefb64c4f req-14bcb76b-a71e-4546-8794-322b13ae3d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ad8510-aade-4207-92c7-6be143f1a70b", "name": "network-vif-plugged", "status": "completed", "tag": "1d198787-253c-4a03-a5a0-37377d7d4628"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:49.063199 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:49.064235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:49.074185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:49.074645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:49.075440 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:49.075902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:49.080652 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-8b63b7c7-ad0b-42b5-ad04-6cbaefb64c4f req-14bcb76b-a71e-4546-8794-322b13ae3d11 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:49.081179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-8b63b7c7-ad0b-42b5-ad04-6cbaefb64c4f req-14bcb76b-a71e-4546-8794-322b13ae3d11 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:49.093262 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-8b63b7c7-ad0b-42b5-ad04-6cbaefb64c4f req-14bcb76b-a71e-4546-8794-322b13ae3d11 service nova] Creating event network-vif-plugged:1d198787-253c-4a03-a5a0-37377d7d4628 for instance 82ad8510-aade-4207-92c7-6be143f1a70b on hv-cinder-79575 May 12 19:05:49.098569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-8b63b7c7-ad0b-42b5-ad04-6cbaefb64c4f req-14bcb76b-a71e-4546-8794-322b13ae3d11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050614 May 12 19:05:49.099478 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 381/776] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:49.241112 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:49.249341 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5af480bb-d7d5-433c-a3ea-5fe37538d918 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1314 microversion: 2.1 time: 0.197789 May 12 19:05:49.249945 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 396/777] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:49 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:50.267523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:50.268245 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:50.274571 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:50.275022 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:50.275794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:50.276236 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:50.411009 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:50.418838 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e01c259f-f8a3-4972-abee-6fb1d43d361c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1314 microversion: 2.1 time: 0.156087 May 12 19:05:50.419402 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 382/778] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:50 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:51.435506 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:51.436143 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:51.442603 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:51.443064 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:51.443830 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:51.444269 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:51.574398 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:51.581980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-912fc7aa-0994-4e23-af39-0fd6351d070c tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1497 microversion: 2.1 time: 0.150267 May 12 19:05:51.582543 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 397/779] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:51 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:52.058927 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:52.059465 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:52.065812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.066265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.067028 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.067501 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.094682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:05:52.177842 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a219fcd2-58bd-4f9b-a706-eaa60c047478 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "DELETE /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 204 len: 0 microversion: 2.1 time: 0.123068 May 12 19:05:52.178348 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 383/780] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:05:52 2022] DELETE /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:05:52.186748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:52.187365 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:52.193616 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.194072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.195025 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.195469 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.340282 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:52.347564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5687c49e-79d4-4256-8818-d70a5067c8b1 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1503 microversion: 2.1 time: 0.164803 May 12 19:05:52.348335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 398/781] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:52 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:52.438348 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d15c6154-ce7c-47bd-b45f-d1c49eb3681a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:52.440323 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d15c6154-ce7c-47bd-b45f-d1c49eb3681a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:52.448667 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d15c6154-ce7c-47bd-b45f-d1c49eb3681a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.449121 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d15c6154-ce7c-47bd-b45f-d1c49eb3681a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.450064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d15c6154-ce7c-47bd-b45f-d1c49eb3681a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.450782 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d15c6154-ce7c-47bd-b45f-d1c49eb3681a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.488666 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d15c6154-ce7c-47bd-b45f-d1c49eb3681a tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054495 May 12 19:05:52.490064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 384/782] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 12 19:05:52 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:52.555531 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:52.556548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:52.563651 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.564096 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.564858 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.565293 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.594097 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:05:52.677468 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-24a8070d-7de7-4d6e-84f7-2ef785d1b5d0 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 204 len: 0 microversion: 2.20 time: 0.125613 May 12 19:05:52.678783 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 399/783] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 12 19:05:52 2022] DELETE /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 19:05:52.686949 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:52.687561 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:52.695286 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.695943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.697056 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:52.697941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:52.843299 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:52.854464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:52.857238 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:52.858903 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-026e1fbd-0e46-4e44-b45b-c0d5576e4546 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.175803 May 12 19:05:52.860025 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 385/784] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:52 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:53.364756 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:53.365456 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:53.371949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:53.372402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:53.373173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:53.373643 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:53.507769 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:53.515171 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-dd1960e3-394a-47b6-b134-002b1ac74072 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1503 microversion: 2.1 time: 0.154509 May 12 19:05:53.515754 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 400/785] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:53 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:53.879138 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:53.880001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:53.886350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:53.886804 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:53.887597 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:53.888035 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:54.019891 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:54.028285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:54.030388 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:54.031799 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1177d6e3-2987-4cfa-9b1f-e5fd913c0807 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.157868 May 12 19:05:54.032572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 386/786] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:53 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:54.532923 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:54.533590 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:54.540587 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:54.541044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:54.541933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:54.542457 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:54.681599 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:54.689919 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4890c128-bc4e-4951-867a-992a6661a96e tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1503 microversion: 2.1 time: 0.160905 May 12 19:05:54.690962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 401/787] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:54 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:55.050181 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:55.050794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:55.057596 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:55.058278 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:55.059301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:55.059650 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:55.384609 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:55.392252 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:55.393770 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:55.394910 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b91506bb-3bee-49f3-8695-ca7bf97b5d50 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1725 microversion: 2.20 time: 0.348875 May 12 19:05:55.395467 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 387/788] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:55 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:55.707994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:55.708705 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:55.715202 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:55.715660 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:55.716437 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:55.716872 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:55.738966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-cbb19b38-b1eb-47cb-8ab4-cfe648097257 req-d915cc60-45fb-4d37-8242-92e2b877897e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ad8510-aade-4207-92c7-6be143f1a70b", "name": "network-vif-deleted", "tag": "1d198787-253c-4a03-a5a0-37377d7d4628"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:55.759062 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-cbb19b38-b1eb-47cb-8ab4-cfe648097257 req-d915cc60-45fb-4d37-8242-92e2b877897e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:55.760636 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-cbb19b38-b1eb-47cb-8ab4-cfe648097257 req-d915cc60-45fb-4d37-8242-92e2b877897e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:55.780523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-cbb19b38-b1eb-47cb-8ab4-cfe648097257 req-d915cc60-45fb-4d37-8242-92e2b877897e service nova] Creating event network-vif-deleted:1d198787-253c-4a03-a5a0-37377d7d4628 for instance 82ad8510-aade-4207-92c7-6be143f1a70b on hv-cinder-79575 May 12 19:05:55.789182 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afe3e5522534562ad835af83b830ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69299e9979554ba2b07a5e29d1b792b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:55.797382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-cbb19b38-b1eb-47cb-8ab4-cfe648097257 req-d915cc60-45fb-4d37-8242-92e2b877897e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062599 May 12 19:05:55.798032 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 388/789] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:55.799090 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-77faafab-eb11-4338-89d1-c27cc394c625 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 200 len: 1461 microversion: 2.1 time: 0.094994 May 12 19:05:55.799706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 402/790] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:55 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 1461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:05:56.416492 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:56.417210 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:56.429112 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:56.434136 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:56.435053 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:56.435739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:56.513166 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:56.521937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:56.523999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:56.525149 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6808646e-54ca-4899-9da6-9e0dbbe7c9e4 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1366 microversion: 2.20 time: 0.116296 May 12 19:05:56.525736 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 389/791] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:56 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:56.816476 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:56.817208 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] [instance: 82ad8510-aade-4207-92c7-6be143f1a70b] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:56.824118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:56.824577 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:56.825358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:56.825823 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:56.840812 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] HTTP exception thrown: Instance 82ad8510-aade-4207-92c7-6be143f1a70b could not be found. May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Request method failure captured: May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b HTTP/1.1 May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVpwOA0kuA4AubLkMAsmedFll4ZI9u2S5Bvhysg06Snfb2Ft8o33XKYhs_fY8YYsnUbZAru6VwLVMGG1IvdzItAl3DG3SGecgLhze5kdGZjCGjc6SHMLY8pgfmf9DHuycoeEoD47mo-wyFmhdX2OLKMwDg8kTK4VSs6LrAhul8HAf0U May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 69299e9979554ba2b07a5e29d1b792b8 May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesActionsTest-1274736931 May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:56.842464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69299e9979554ba2b07a5e29d1b792b8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69299e9979554ba2b07a5e29d1b792b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69299e9979554ba2b07a5e29d1b792b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69299e9979554ba2b07a5e29d1b792b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesActionsTest-1274736931 May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 69299e9979554ba2b07a5e29d1b792b8 May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesActionsTest-1274736931 May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesActionsTest-1274736931-project May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 4afe3e5522534562ad835af83b830ab9 May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesActionsTest-1274736931-project May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 82ad8510-aade-4207-92c7-6be143f1a70b could not be found. May 12 19:05:56.844093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '82ad8510-aade-4207-92c7-6be143f1a70b'} May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ad8510-aade-4207-92c7-6be143f1a70b could not be found. May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:56.844898 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ad8510-aade-4207-92c7-6be143f1a70b could not be found. May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ad8510-aade-4207-92c7-6be143f1a70b could not be found. May 12 19:05:56.846146 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:56.847234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] Returning 404 to user: Instance 82ad8510-aade-4207-92c7-6be143f1a70b could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:56.847234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e5c26e58-52d0-4ea6-bde7-f604b0b9c1f4 tempest-VolumesActionsTest-1274736931 tempest-VolumesActionsTest-1274736931-project] 10.222.0.48 "GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b" status: 404 len: 111 microversion: 2.1 time: 0.031251 May 12 19:05:56.847234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 403/792] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:05:56 2022] GET /compute/v2.1/servers/82ad8510-aade-4207-92c7-6be143f1a70b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:05:57.543894 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:57.544508 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:57.551149 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:57.552887 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:57.553742 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:57.554190 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:57.616677 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:57.624383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:57.625880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:57.627018 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ff96f009-cd7c-4a4f-9b19-fd9a903e1b3b tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1366 microversion: 2.20 time: 0.087267 May 12 19:05:57.627563 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 390/793] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:57 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:57.830888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-ee08771c-e551-4863-a9b4-e9cfbaa1a6e0 req-c76860bc-88ff-4520-8cf2-0b99e1b04291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651ff207-805c-42db-9da8-6e493ecdd78e", "name": "network-vif-deleted", "tag": "d6ee4e3b-c3f4-4c30-877e-37f58454c827"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:05:57.841270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ee08771c-e551-4863-a9b4-e9cfbaa1a6e0 req-c76860bc-88ff-4520-8cf2-0b99e1b04291 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:57.841905 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ee08771c-e551-4863-a9b4-e9cfbaa1a6e0 req-c76860bc-88ff-4520-8cf2-0b99e1b04291 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:57.853515 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-ee08771c-e551-4863-a9b4-e9cfbaa1a6e0 req-c76860bc-88ff-4520-8cf2-0b99e1b04291 service nova] Creating event network-vif-deleted:d6ee4e3b-c3f4-4c30-877e-37f58454c827 for instance 651ff207-805c-42db-9da8-6e493ecdd78e on hv-cinder-79575 May 12 19:05:57.858235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-ee08771c-e551-4863-a9b4-e9cfbaa1a6e0 req-c76860bc-88ff-4520-8cf2-0b99e1b04291 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 May 12 19:05:57.859093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 404/794] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:05:58.644565 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:58.645170 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:58.652085 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:58.652528 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:58.653284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:58.653741 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:58.682562 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:58.683004 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:58.683446 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lazy-loading 'fault' on Instance uuid 651ff207-805c-42db-9da8-6e493ecdd78e {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:05:58.729046 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:58.736981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:58.738411 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '803b29a8c5e34ef0993913c0b08ccfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a8b3b5b2c48416c8c6b99b27cfa3aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:05:58.739547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-862f5867-bbdc-4c71-a88d-83faf95b4326 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 200 len: 1371 microversion: 2.20 time: 0.098830 May 12 19:05:58.740282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 391/795] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:58 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 19:05:59.758254 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:59.758947 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:05:59.765326 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:59.765809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:59.766575 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:05:59.767007 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:05:59.780934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] HTTP exception thrown: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Request method failure captured: May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e HTTP/1.1 May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkfQ-Ce5_w2D9E7b9S_rmAAUF8HxjZHalhYvaft_diBSfSvyGUPByEVlsGxtmsk5c6Gq4W2BL91rcbdCs48ogL3XsC0LYfb9jndncQPZ1QZkf7fgFJdvziWmnPTMxuXYRgCMWjEVQTJQCw4JaosMcrkVpFM0Nii6Ge-16k-rLoJ-r8 May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Openstack-Nova-Api-Version: 2.20 May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:05:59.782578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a8b3b5b2c48416c8c6b99b27cfa3aeb", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 803b29a8c5e34ef0993913c0b08ccfd1 May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:05:59.784232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '651ff207-805c-42db-9da8-6e493ecdd78e'} May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:05:59.785183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:05:59.786668 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:05:59.788000 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Returning 404 to user: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:05:59.788000 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2f9a7fe0-3ef0-4dc2-be84-bd14bdcdd9f2 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 404 len: 111 microversion: 2.20 time: 0.030112 May 12 19:05:59.788000 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 405/796] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:05:59 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 19:05:59.794136 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1d7ce869-0621-4c5e-8eab-97ab432e5930 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '.version_select at 0x7f38c76ca940>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:05:59.812244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1d7ce869-0621-4c5e-8eab-97ab432e5930 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-239890967" status: 204 len: 0 microversion: 2.20 time: 0.021843 May 12 19:05:59.812812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 392/797] 10.222.0.48 () {60 vars in 1258 bytes} [Thu May 12 19:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-239890967 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 19:06:05.960154 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:05.960730 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:05.968377 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:05.969116 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:05.970373 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:05.971100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:05.985887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] HTTP exception thrown: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Request method failure captured: May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e HTTP/1.1 May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkfQ-Ce5_w2D9E7b9S_rmAAUF8HxjZHalhYvaft_diBSfSvyGUPByEVlsGxtmsk5c6Gq4W2BL91rcbdCs48ogL3XsC0LYfb9jndncQPZ1QZkf7fgFJdvziWmnPTMxuXYRgCMWjEVQTJQCw4JaosMcrkVpFM0Nii6Ge-16k-rLoJ-r8 May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Openstack-Nova-Api-Version: 2.20 May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:06:05.987465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a8b3b5b2c48416c8c6b99b27cfa3aeb", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 803b29a8c5e34ef0993913c0b08ccfd1 May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:05.989279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '651ff207-805c-42db-9da8-6e493ecdd78e'} May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:06:05.990484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:05.992888 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:05.995961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Returning 404 to user: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:06:05.995961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a9e503f2-66ec-492f-b7b5-86592137fc8e tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 404 len: 111 microversion: 2.20 time: 0.033558 May 12 19:06:06.000982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:06.001979 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: 651ff207-805c-42db-9da8-6e493ecdd78e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:06.008453 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:06.008900 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:06.009614 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 406/798] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 12 19:06:05 2022] DELETE /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 19:06:06.009805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:06.010211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:06.026854 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] HTTP exception thrown: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Request method failure captured: May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e HTTP/1.1 May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkfQ-Ce5_w2D9E7b9S_rmAAUF8HxjZHalhYvaft_diBSfSvyGUPByEVlsGxtmsk5c6Gq4W2BL91rcbdCs48ogL3XsC0LYfb9jndncQPZ1QZkf7fgFJdvziWmnPTMxuXYRgCMWjEVQTJQCw4JaosMcrkVpFM0Nii6Ge-16k-rLoJ-r8 May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Openstack-Nova-Api-Version: 2.20 May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:06:06.028499 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a8b3b5b2c48416c8c6b99b27cfa3aeb", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 803b29a8c5e34ef0993913c0b08ccfd1 May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:06.030542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '651ff207-805c-42db-9da8-6e493ecdd78e'} May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:06:06.031413 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. May 12 19:06:06.032857 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:06.035355 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Returning 404 to user: Instance 651ff207-805c-42db-9da8-6e493ecdd78e could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:06:06.035355 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2be13d35-e36f-4005-9c62-ef7f6a0d63ad tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e" status: 404 len: 111 microversion: 2.20 time: 0.034840 May 12 19:06:06.035355 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 393/799] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:06:05 2022] GET /compute/v2.1/servers/651ff207-805c-42db-9da8-6e493ecdd78e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 19:06:07.187397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:07.187945 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:07.196220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:07.196691 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:07.197470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:07.197939 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:07.212497 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] HTTP exception thrown: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Request method failure captured: May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 HTTP/1.1 May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVkfQ-Ce5_w2D9E7b9S_rmAAUF8HxjZHalhYvaft_diBSfSvyGUPByEVlsGxtmsk5c6Gq4W2BL91rcbdCs48ogL3XsC0LYfb9jndncQPZ1QZkf7fgFJdvziWmnPTMxuXYRgCMWjEVQTJQCw4JaosMcrkVpFM0Nii6Ge-16k-rLoJ-r8 May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Openstack-Nova-Api-Version: 2.20 May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:06:07.214131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a8b3b5b2c48416c8c6b99b27cfa3aeb", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 803b29a8c5e34ef0993913c0b08ccfd1 May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.215465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': 'f3fae6df-666d-4354-9089-87b51631cb48'} May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:06:07.216173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.220325 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:06:07.221497 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Returning 404 to user: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:06:07.221497 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-939f0339-0be2-48c6-a13b-689b34521e38 tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 404 len: 111 microversion: 2.20 time: 0.032164 May 12 19:06:07.221497 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 407/800] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 12 19:06:07 2022] DELETE /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 19:06:07.224497 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:07.225170 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] [instance: f3fae6df-666d-4354-9089-87b51631cb48] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:07.232911 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:07.233381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:07.234243 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:07.234682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:07.251696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] HTTP exception thrown: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Request method failure captured: May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 HTTP/1.1 May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVkfQ-Ce5_w2D9E7b9S_rmAAUF8HxjZHalhYvaft_diBSfSvyGUPByEVlsGxtmsk5c6Gq4W2BL91rcbdCs48ogL3XsC0LYfb9jndncQPZ1QZkf7fgFJdvziWmnPTMxuXYRgCMWjEVQTJQCw4JaosMcrkVpFM0Nii6Ge-16k-rLoJ-r8 May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Openstack-Nova-Api-Version: 2.20 May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:06:07.253929 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a8b3b5b2c48416c8c6b99b27cfa3aeb", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a8b3b5b2c48416c8c6b99b27cfa3aeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 2a8b3b5b2c48416c8c6b99b27cfa3aeb May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-172291899 May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 803b29a8c5e34ef0993913c0b08ccfd1 May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-AttachVolumeShelveTestJSON-172291899-project May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.255377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'f3fae6df-666d-4354-9089-87b51631cb48'} May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:06:07.256115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. May 12 19:06:07.257379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:06:07.258616 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] Returning 404 to user: Instance f3fae6df-666d-4354-9089-87b51631cb48 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:06:07.258616 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8b79f631-ed0a-4915-b705-24b418faa68d tempest-AttachVolumeShelveTestJSON-172291899 tempest-AttachVolumeShelveTestJSON-172291899-project] 10.222.0.48 "GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48" status: 404 len: 111 microversion: 2.20 time: 0.035377 May 12 19:06:07.258616 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 394/801] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 12 19:06:07 2022] GET /compute/v2.1/servers/f3fae6df-666d-4354-9089-87b51631cb48 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 19:06:37.730099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-895121040", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "networks": [{"uuid": "2997f016-b318-4e70-8380-fdb20cba3a19"}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:06:37.790284 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] validate_networks() for [('2997f016-b318-4e70-8380-fdb20cba3a19', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:06:38.417552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:06:38.418210 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:06:38.418688 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:06:38.419093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:06:38.419679 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:06:38.428743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:38.429350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:38.430415 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:38.430946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:38.448526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Getting quotas for project 3ff6e876f1ec44939bebef28b7dac12b. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:06:38.452916 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Getting quotas for user 9e68f1722227477cbbacd4813cd4f4bc and project 3ff6e876f1ec44939bebef28b7dac12b. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:06:38.473295 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:06:38.475979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:06:38.522826 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2e49d681-280f-4964-907e-f7c69184c5a8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797899 May 12 19:06:38.523464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 408/802] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:06:38.540444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-03b6a8bd-6a27-48a6-b817-cdfc72a655ea tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:38.541727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-03b6a8bd-6a27-48a6-b817-cdfc72a655ea tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:38.652434 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-03b6a8bd-6a27-48a6-b817-cdfc72a655ea tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:38.660631 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-03b6a8bd-6a27-48a6-b817-cdfc72a655ea tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1218 microversion: 2.1 time: 0.124225 May 12 19:06:38.661588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 395/803] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:38 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:39.678617 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:39.679914 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:39.686406 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:39.687121 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:39.693107 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:39.693970 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:39.795771 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:39.804054 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-679a84ce-7ce2-4984-b70d-43b621493010 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1278 microversion: 2.1 time: 0.130797 May 12 19:06:39.814555 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 409/804] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:39 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:40.821208 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:40.821847 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:40.828317 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:40.829003 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:40.830077 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:40.830664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:41.111272 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:41.122459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e0b07f36-73c4-40a2-8350-8634995c2d14 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1318 microversion: 2.1 time: 0.304039 May 12 19:06:41.134392 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 396/805] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:40 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:41.637020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-118f67bd-ed80-404c-88a9-3df88049915d req-23d74c3d-fdff-4666-a9ac-db53e1dd674b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16717c9-58f5-44ba-b7a5-881db819a3db", "tag": "450fe8c5-775f-4706-a48a-71d489c1b53d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:06:41.660556 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-118f67bd-ed80-404c-88a9-3df88049915d req-23d74c3d-fdff-4666-a9ac-db53e1dd674b service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:41.661927 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-118f67bd-ed80-404c-88a9-3df88049915d req-23d74c3d-fdff-4666-a9ac-db53e1dd674b service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:41.677352 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-118f67bd-ed80-404c-88a9-3df88049915d req-23d74c3d-fdff-4666-a9ac-db53e1dd674b service nova] Creating event network-changed:450fe8c5-775f-4706-a48a-71d489c1b53d for instance a16717c9-58f5-44ba-b7a5-881db819a3db on hv-cinder-79575 May 12 19:06:41.683005 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-118f67bd-ed80-404c-88a9-3df88049915d req-23d74c3d-fdff-4666-a9ac-db53e1dd674b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050907 May 12 19:06:41.685037 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 410/806] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:06:42.140970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:42.144996 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:42.151885 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:42.152799 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:42.153815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:42.154254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:42.331308 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:42.341259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-57017034-6c10-415a-9f92-a89c7f572e58 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1318 microversion: 2.1 time: 0.205168 May 12 19:06:42.350765 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 397/807] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:42 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:43.359533 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:43.360250 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:43.379239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:43.380165 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:43.381832 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:43.382446 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:43.717604 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:43.733907 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e0069913-6cdc-4cf1-bd55-6ddd58bca3f7 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1318 microversion: 2.1 time: 0.378660 May 12 19:06:43.735746 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 411/808] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:43 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:44.751837 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:44.753300 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:44.767226 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:44.770509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:44.771345 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:44.771788 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:45.163993 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:45.180459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b9c54df9-a034-4e2f-9b41-29d1846278b2 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1318 microversion: 2.1 time: 0.433000 May 12 19:06:45.183264 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 398/809] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:44 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:46.200227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:46.203435 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:46.212641 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:46.213928 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:46.215784 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:46.216749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:46.561876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:46.574654 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-532aaba0-1682-4c1b-acc1-a8be220ac6ae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1318 microversion: 2.1 time: 0.380150 May 12 19:06:46.575943 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 412/810] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:46 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:47.264156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-2e918ef4-a56c-4413-b19c-ce35406e65e2 req-e98d3638-8c5f-455b-85df-a10dabbd7c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16717c9-58f5-44ba-b7a5-881db819a3db", "name": "network-vif-plugged", "status": "completed", "tag": "450fe8c5-775f-4706-a48a-71d489c1b53d"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:06:47.289211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-2e918ef4-a56c-4413-b19c-ce35406e65e2 req-e98d3638-8c5f-455b-85df-a10dabbd7c04 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:47.290711 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-2e918ef4-a56c-4413-b19c-ce35406e65e2 req-e98d3638-8c5f-455b-85df-a10dabbd7c04 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:47.312188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-2e918ef4-a56c-4413-b19c-ce35406e65e2 req-e98d3638-8c5f-455b-85df-a10dabbd7c04 service nova] Creating event network-vif-plugged:450fe8c5-775f-4706-a48a-71d489c1b53d for instance a16717c9-58f5-44ba-b7a5-881db819a3db on hv-cinder-79575 May 12 19:06:47.322824 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-2e918ef4-a56c-4413-b19c-ce35406e65e2 req-e98d3638-8c5f-455b-85df-a10dabbd7c04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069011 May 12 19:06:47.324344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 399/811] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:06:47.591799 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:47.592416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:47.603516 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:47.604229 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:47.606288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:47.607690 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:47.857859 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:47.867610 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1d05e800-4309-464f-8a18-c73669a98334 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1318 microversion: 2.1 time: 0.277988 May 12 19:06:47.868232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 413/812] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:47 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:48.885710 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:48.886410 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:48.895092 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:48.895541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:48.896326 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:48.896766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:49.087476 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:49.095728 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-996db18d-7c8a-4fb3-bdfb-29f6f32d15d0 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1318 microversion: 2.1 time: 0.214639 May 12 19:06:49.098263 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 400/813] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:48 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:50.113923 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:50.114711 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:50.127114 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:50.129982 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:50.131020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:50.131685 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:50.358430 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:50.367414 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ea9ecd97-dbbd-4dec-9d3d-0862a735a474 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1507 microversion: 2.1 time: 0.258602 May 12 19:06:50.368557 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 414/814] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:50 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:06:59.192572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-375078c6-bb1e-493b-be8a-e6995f65a92d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Action: 'create', calling method: .version_select at 0x7f38c2368160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-771332876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqpv/BPfZhsMIF0iWhSE72iY6UfNkuhd6NkEFa2+FikkVkxbIVYE86Pwg/U+GB9g4M4jnHJZLt2MUrKY0sOnoAX4cS5I6X+PWnCi/Eg6PJFO+57GHb0hQFOdL5QCfsZCA=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:06:59.215219 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-375078c6-bb1e-493b-be8a-e6995f65a92d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Getting quotas for project ac196e75b746478c8ca28495d0971916. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:06:59.219423 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-375078c6-bb1e-493b-be8a-e6995f65a92d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Getting quotas for user 345b44fe3ae849fb8f0a529d33e64679 and project ac196e75b746478c8ca28495d0971916. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:06:59.249659 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-375078c6-bb1e-493b-be8a-e6995f65a92d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061878 May 12 19:06:59.250272 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 401/815] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:06:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:06:59.351699 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1800665525", "imageRef": "3320079c-8f8a-4ef2-875d-cb69bf25afb1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-771332876", "networks": [{"uuid": "3efc05f7-f2fa-4b9e-a486-1d1e78ad668f"}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:06:59.419486 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] validate_networks() for [('3efc05f7-f2fa-4b9e-a486-1d1e78ad668f', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:06:59.831940 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:06:59.832366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:06:59.832840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:06:59.833249 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:06:59.833715 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:06:59.842445 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:59.842897 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:59.843860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:06:59.844306 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:06:59.861406 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Getting quotas for project ac196e75b746478c8ca28495d0971916. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:06:59.865976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Getting quotas for user 345b44fe3ae849fb8f0a529d33e64679 and project ac196e75b746478c8ca28495d0971916. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:06:59.876653 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:06:59.879539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320079c-8f8a-4ef2-875d-cb69bf25afb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:06:59.923933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0d0c871e-8b08-4522-97b9-e4c308b87ae5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576413 May 12 19:06:59.924563 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 415/816] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:06:59.934698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-6f318d99-ee51-4cd3-bb02-90c13284955c tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:06:59.935316 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-6f318d99-ee51-4cd3-bb02-90c13284955c tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:06:59.993315 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-6f318d99-ee51-4cd3-bb02-90c13284955c tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:06:59.999890 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-6f318d99-ee51-4cd3-bb02-90c13284955c tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1258 microversion: 2.1 time: 0.069009 May 12 19:07:00.000462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 402/817] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:06:59 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:01.016617 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:01.017244 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:01.023852 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:01.024311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:01.025089 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:01.025554 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:01.085449 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:01.092820 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-771bb864-dc8e-431a-931e-9d0f67871c22 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1262 microversion: 2.1 time: 0.080488 May 12 19:07:01.093385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 416/818] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:01 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:02.110876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:02.112186 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:02.119948 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:02.120395 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:02.121230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:02.121725 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:02.187503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:02.196194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4b0cf0b2-99e5-46ee-9291-45dcd6086903 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1254 microversion: 2.1 time: 0.090430 May 12 19:07:02.200270 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 403/819] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:02 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1254 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:03.212830 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:03.213452 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:03.219868 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:03.220264 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:03.221082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:03.221551 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:03.451480 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:03.460423 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-36836e1f-bb90-4ace-9db0-d23fb7823289 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.251433 May 12 19:07:03.464941 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 417/820] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:03 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:04.416801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-884d92f7-2ec0-4cc4-ad08-638226962920 req-0a7c234a-ffa2-4cb5-a71b-d75f53c08906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be0dc2-dd8c-46a6-b325-a810b21708e0", "tag": "c55cf03b-d589-4c2a-9552-6206a1a5b978"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:04.427706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-884d92f7-2ec0-4cc4-ad08-638226962920 req-0a7c234a-ffa2-4cb5-a71b-d75f53c08906 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:04.428469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-884d92f7-2ec0-4cc4-ad08-638226962920 req-0a7c234a-ffa2-4cb5-a71b-d75f53c08906 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:04.441071 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-884d92f7-2ec0-4cc4-ad08-638226962920 req-0a7c234a-ffa2-4cb5-a71b-d75f53c08906 service nova] Creating event network-changed:c55cf03b-d589-4c2a-9552-6206a1a5b978 for instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 on hv-cinder-79575 May 12 19:07:04.446287 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-884d92f7-2ec0-4cc4-ad08-638226962920 req-0a7c234a-ffa2-4cb5-a71b-d75f53c08906 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033050 May 12 19:07:04.447156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 404/821] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:07:04.483482 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:04.484196 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:04.496677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:04.498226 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:04.499334 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:04.499986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:04.749155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:04.756477 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8a546a5f-77ff-4928-a681-3fd15ecbf5f8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.278193 May 12 19:07:04.757047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 418/822] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:04 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:05.779375 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:05.780394 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:05.790080 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:05.790663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:05.791533 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:05.792069 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:05.974660 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:05.983367 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-888eada5-0851-41ca-82eb-94affd883996 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.210133 May 12 19:07:05.983959 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 405/823] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:05 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:07.006544 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:07.007214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:07.014311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:07.015020 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:07.015821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:07.016274 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:07.173064 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:07.181363 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-26fad3bd-ba63-402b-a693-668465cfedd5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.180168 May 12 19:07:07.182530 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 419/824] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:06 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:08.204345 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:08.205672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:08.214254 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:08.214706 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:08.215740 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:08.216404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:08.437829 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:08.448079 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0f5658af-eb54-46de-b940-ca489fe8cb37 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.247868 May 12 19:07:08.449320 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 406/825] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:08 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:09.468788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:09.469677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:09.479133 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:09.480291 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:09.481296 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:09.481972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:09.690785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:09.708568 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-10cc4110-2809-4a20-9386-e3fb6cd4aa00 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.244076 May 12 19:07:09.709236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 420/826] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:09 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:10.726967 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:10.728536 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:10.743618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:10.750415 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:10.751662 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:10.752794 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:10.951703 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:10.962739 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3a785f8a-3e72-466a-b6bb-b7c74877455e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.239513 May 12 19:07:10.964284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 407/827] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:10 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:07:11.981172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:11.982659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:11.992125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:12.001150 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:12.008386 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:12.009210 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:12.230793 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:12.240503 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9f3b6a13-6a71-4c23-9a8e-fc03e9906772 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.263752 May 12 19:07:12.250821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 421/828] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:11 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:13.275157 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:13.275901 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:13.295590 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:13.302677 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:13.303797 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:13.304392 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:13.709433 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:13.716914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1fbbdbb0-6265-4b05-8413-439c85ad6cf2 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.450081 May 12 19:07:13.717896 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 408/829] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:13 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:14.735148 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:14.736131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:14.748241 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:14.748699 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:14.749478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:14.750628 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:14.891121 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:14.902180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-44295f66-6576-4599-96aa-35802c34e6dd tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.170807 May 12 19:07:14.902767 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 422/830] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:14 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:15.919634 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:15.920548 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:15.927466 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:15.928098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:15.928923 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:15.929605 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:16.107338 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:16.116390 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-812e482b-ff0c-4632-a739-cec84e097af5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.201396 May 12 19:07:16.117352 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 409/831] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:15 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:17.136359 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:17.137584 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:17.145400 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:17.145881 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:17.146671 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:17.147349 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:17.391662 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:17.406117 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-844396a2-b62e-46bb-b769-860fb6497ae1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.276165 May 12 19:07:17.406820 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 423/832] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:17 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:18.429970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:18.432457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:18.449449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:18.450197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:18.451480 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:18.452104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:18.742201 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:18.758631 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-4cc439c5-f60b-43ea-9f41-0b7364791994 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.338116 May 12 19:07:18.760548 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 410/833] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:18 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:19.776866 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:19.777661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:19.787080 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:19.787889 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:19.789011 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:19.789764 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:19.940539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:19.949803 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-d4603436-73f8-4f95-ada3-a0ddf7d7517c req-ce756504-6e81-4d3e-aff2-e45f330ac15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59be0dc2-dd8c-46a6-b325-a810b21708e0", "name": "network-vif-plugged", "status": "completed", "tag": "c55cf03b-d589-4c2a-9552-6206a1a5b978"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:19.952396 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-56d61614-d97a-4dce-9d97-e711ba22ab54 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.180525 May 12 19:07:19.954096 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 424/834] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:19 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:19.969903 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d4603436-73f8-4f95-ada3-a0ddf7d7517c req-ce756504-6e81-4d3e-aff2-e45f330ac15d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:19.970352 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d4603436-73f8-4f95-ada3-a0ddf7d7517c req-ce756504-6e81-4d3e-aff2-e45f330ac15d service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:19.983510 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-d4603436-73f8-4f95-ada3-a0ddf7d7517c req-ce756504-6e81-4d3e-aff2-e45f330ac15d service nova] Creating event network-vif-plugged:c55cf03b-d589-4c2a-9552-6206a1a5b978 for instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 on hv-cinder-79575 May 12 19:07:19.989376 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-d4603436-73f8-4f95-ada3-a0ddf7d7517c req-ce756504-6e81-4d3e-aff2-e45f330ac15d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044744 May 12 19:07:19.990015 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 411/835] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:07:20.722279 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-446a0669-775d-4116-a7da-63d6359f51d7 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Action: 'create', calling method: .version_select at 0x7f38c2361a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-417828809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb7YkZrymVm3dLNx7vpiNoyv89SEgrZa2ZXGFNb9Yjk4CxgwDq1wgEPdQe0uhs1lN2kLKFDCN5kpmoJ/h/Ne5ufydmrchNu932E+ilcF9ro9YCZCxxE+pGfyMdBM2Zepw=="}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:20.737910 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-446a0669-775d-4116-a7da-63d6359f51d7 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:07:20.741665 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-446a0669-775d-4116-a7da-63d6359f51d7 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for user dfae4bc82b774dc1bb8c98990b6a4ac7 and project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'key_pairs'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:07:20.764646 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-446a0669-775d-4116-a7da-63d6359f51d7 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.210405 May 12 19:07:20.765243 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 425/836] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:07:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:07:20.972682 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:20.973393 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:20.979663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:20.980372 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:20.981161 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:20.981623 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:21.227900 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d4a6921e-b534-405e-80cc-c4972f46439b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4236a9a8-bf75-491a-a918-e9225d4da76e", "device": "/dev/sdb"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:21.229944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d4a6921e-b534-405e-80cc-c4972f46439b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:21.233166 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:21.242332 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d4a6921e-b534-405e-80cc-c4972f46439b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:21.242724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c933038e-c847-461c-8af3-6c045c1088ce tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1358 microversion: 2.1 time: 0.276408 May 12 19:07:21.244171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 412/837] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:20 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:21.252097 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d4a6921e-b534-405e-80cc-c4972f46439b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:21.253124 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d4a6921e-b534-405e-80cc-c4972f46439b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:21.258989 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d4a6921e-b534-405e-80cc-c4972f46439b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:22.076659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d4a6921e-b534-405e-80cc-c4972f46439b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "POST /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853740 May 12 19:07:22.077422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 426/838] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:07:21 2022] POST /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:07:22.259202 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:22.259819 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:22.269315 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:22.269789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:22.270569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:22.271006 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:22.438937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:22.450153 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9d22322c-2a1e-43c4-b766-b0f0573189ff tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1547 microversion: 2.1 time: 0.194725 May 12 19:07:22.450733 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 413/839] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:22 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1547 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:22.471411 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:22.474109 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:22.487499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:22.489040 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:22.491839 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:22.494293 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:22.642180 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:22.649502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d14da8b3-4a83-47bf-b11b-021044af4858 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1547 microversion: 2.1 time: 0.185689 May 12 19:07:22.650094 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 427/840] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:22 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:22.665817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:22.669285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:22.670058 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Searching by: {'deleted': False, 'project_id': 'ac196e75b746478c8ca28495d0971916'} {{(pid=117101) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 19:07:22.676963 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:22.677396 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:22.678231 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:22.678781 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:22.775340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.multi_cell_list [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117101) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 19:07:23.054469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e6c33dc7-7e48-417d-946b-42afd4153670 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.392287 May 12 19:07:23.055054 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 414/841] 10.222.0.48 () {58 vars in 1124 bytes} [Thu May 12 19:07:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:07:23.065087 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:23.065765 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:23.072134 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:23.072591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:23.073374 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:23.073842 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:23.242732 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:23.250511 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e93e483e-fb6a-4190-8d8a-f99abc01bf7b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1547 microversion: 2.1 time: 0.189204 May 12 19:07:23.251796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 428/842] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:23 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1547 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:24.865751 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f8564516-53fa-4395-a7fc-7fcfb72cfe6d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "893649e4-e9d7-4154-900f-3d46d09d1881"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:24.866927 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f8564516-53fa-4395-a7fc-7fcfb72cfe6d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:24.873415 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8564516-53fa-4395-a7fc-7fcfb72cfe6d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:24.873901 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8564516-53fa-4395-a7fc-7fcfb72cfe6d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:24.874684 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8564516-53fa-4395-a7fc-7fcfb72cfe6d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:24.875119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8564516-53fa-4395-a7fc-7fcfb72cfe6d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:27.423663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f8564516-53fa-4395-a7fc-7fcfb72cfe6d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.561805 May 12 19:07:27.424298 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 415/843] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:07:24 2022] POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments => generated 194 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:07:38.189857 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:38.190734 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:38.196790 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:38.197240 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:38.198038 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:38.198474 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:38.332312 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:38.340720 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a21c0b12-6219-4601-b10f-4f584ed3213f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1593 microversion: 2.1 time: 0.155191 May 12 19:07:38.341288 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 429/844] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:38 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:40.275356 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-78ddeac6-9c3a-4ca3-9700-77ab06f69542 req-3337c8c8-bb5e-41ab-a6a0-5db69e0dbdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be0dc2-dd8c-46a6-b325-a810b21708e0", "tag": "c55cf03b-d589-4c2a-9552-6206a1a5b978"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:40.295397 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-78ddeac6-9c3a-4ca3-9700-77ab06f69542 req-3337c8c8-bb5e-41ab-a6a0-5db69e0dbdf7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:40.296054 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-78ddeac6-9c3a-4ca3-9700-77ab06f69542 req-3337c8c8-bb5e-41ab-a6a0-5db69e0dbdf7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:40.308274 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-78ddeac6-9c3a-4ca3-9700-77ab06f69542 req-3337c8c8-bb5e-41ab-a6a0-5db69e0dbdf7 service nova] Creating event network-changed:c55cf03b-d589-4c2a-9552-6206a1a5b978 for instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 on hv-cinder-79575 May 12 19:07:40.313679 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-78ddeac6-9c3a-4ca3-9700-77ab06f69542 req-3337c8c8-bb5e-41ab-a6a0-5db69e0dbdf7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186534 May 12 19:07:40.314292 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 416/845] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:07:41.043464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1779301403"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:41.044185 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:41.051163 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:41.051619 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:41.052436 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:41.052876 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:41.183337 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.network.security_group_api [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Adding security group 80c9565a-db98-4c47-bbb4-f58067b13aa7 to port c55cf03b-d589-4c2a-9552-6206a1a5b978 May 12 19:07:41.585320 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-85a7f557-8306-46bc-acd5-a24394edbdb5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/action" status: 202 len: 0 microversion: 2.1 time: 0.545899 May 12 19:07:41.585975 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 430/846] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:07:41 2022] POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:07:41.596880 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:41.598135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:41.598703 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-5c2daaa0-9e7a-487d-ac8f-25123f054d09 req-e5413bef-cc31-4f9a-a5bc-f967c6c4aa89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be0dc2-dd8c-46a6-b325-a810b21708e0", "tag": "c55cf03b-d589-4c2a-9552-6206a1a5b978"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:41.604965 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:41.605626 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:41.606417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:41.606856 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:41.610850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-5c2daaa0-9e7a-487d-ac8f-25123f054d09 req-e5413bef-cc31-4f9a-a5bc-f967c6c4aa89 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:41.611585 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-5c2daaa0-9e7a-487d-ac8f-25123f054d09 req-e5413bef-cc31-4f9a-a5bc-f967c6c4aa89 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:41.625591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-5c2daaa0-9e7a-487d-ac8f-25123f054d09 req-e5413bef-cc31-4f9a-a5bc-f967c6c4aa89 service nova] Creating event network-changed:c55cf03b-d589-4c2a-9552-6206a1a5b978 for instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 on hv-cinder-79575 May 12 19:07:41.630979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-5c2daaa0-9e7a-487d-ac8f-25123f054d09 req-e5413bef-cc31-4f9a-a5bc-f967c6c4aa89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036048 May 12 19:07:41.632201 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 431/847] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:07:41.765125 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:41.773337 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-39fef66b-6bc4-4145-a7c2-5bebe8c411d1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1640 microversion: 2.1 time: 0.182145 May 12 19:07:41.773933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 417/848] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:41 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1640 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:44.210870 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 19:07:44.211531 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Thu May 12 19:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 19:07:44.816454 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-756290590", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-417828809", "security_groups": [{"name": "tempest-secgroup-smoke-1462802288"}], "block_device_mapping_v2": [{"uuid": "9f023821-0069-43eb-8169-3aa3f37e1bdd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c023c40-b2da-44b2-b84e-b8fea4bf4942"}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:44.931017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] validate_networks() for [('9c023c40-b2da-44b2-b84e-b8fea4bf4942', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:07:45.313704 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:07:45.314199 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:07:45.314752 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:07:45.315239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:07:45.315718 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:07:45.324531 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:45.325049 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:45.325979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:45.326487 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:45.344416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:07:45.352141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for user dfae4bc82b774dc1bb8c98990b6a4ac7 and project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:07:45.408890 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:07:45.411188 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f023821-0069-43eb-8169-3aa3f37e1bdd',volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:07:45.541965 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bf2735b7-207a-4982-85a4-d1ebb4e75360 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730356 May 12 19:07:45.542742 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 432/849] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:07:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:07:45.553539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-402d45f2-ea97-4330-9b87-287861fd9eef tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:45.554154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-402d45f2-ea97-4330-9b87-287861fd9eef tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:45.621339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-402d45f2-ea97-4330-9b87-287861fd9eef tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:45.629734 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-402d45f2-ea97-4330-9b87-287861fd9eef tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1093 microversion: 2.1 time: 0.080009 May 12 19:07:45.630392 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 418/850] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:45 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:45.855314 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:45.856591 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:45.865823 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:45.866417 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:45.867275 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:45.867786 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:45.964410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lazy-loading 'services' on Instance uuid a16717c9-58f5-44ba-b7a5-881db819a3db {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:07:46.043955 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2c894ab4-8a3d-43c0-97d6-066dea18f775 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db/os-volume_attachments/4236a9a8-bf75-491a-a918-e9225d4da76e" status: 202 len: 0 microversion: 2.1 time: 0.193472 May 12 19:07:46.044734 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 433/851] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:07:45 2022] DELETE /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db/os-volume_attachments/4236a9a8-bf75-491a-a918-e9225d4da76e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:07:46.646887 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:46.647581 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:46.661941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:46.662404 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:46.663258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:46.663709 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:46.731131 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:46.742517 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-69a3c239-9453-4e26-840d-3a7205b38f42 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1191 microversion: 2.1 time: 0.099265 May 12 19:07:46.743229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 419/852] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:46 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:47.164980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:47.166231 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:47.173277 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:47.173770 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:47.174618 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:47.175058 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:47.200943 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:07:47.290894 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-740e58c6-d75b-4172-bcb4-047c942d6815 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 204 len: 0 microversion: 2.1 time: 0.128941 May 12 19:07:47.291526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 434/853] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:07:47 2022] DELETE /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 19:07:47.300046 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:47.300666 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:47.307397 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:47.307876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:47.308855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:47.309962 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:47.448351 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:47.456211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f8f114d0-e42f-44b4-8384-c68153969049 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1513 microversion: 2.1 time: 0.160239 May 12 19:07:47.457127 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 420/854] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:47 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:47.760456 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:47.761170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:47.767151 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:47.767606 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:47.768378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:47.768823 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:47.831121 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:47.838393 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ccfc529c-7812-4b7e-b478-aec2c6cc1ad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1209 microversion: 2.1 time: 0.082145 May 12 19:07:47.838964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 435/855] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:47 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:48.474834 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:48.475456 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:48.481760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:48.482216 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:48.482988 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:48.483925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:48.612664 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:48.619988 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f98f6f80-b847-4b3a-b964-be53f4076b8e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1513 microversion: 2.1 time: 0.149024 May 12 19:07:48.620546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 421/856] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:48 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:48.855132 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:48.855749 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:48.862703 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:48.863099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:48.863864 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:48.864306 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:48.923847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:48.931721 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-19e7c3aa-8f93-4850-8095-156de74be91f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1209 microversion: 2.1 time: 0.080344 May 12 19:07:48.932285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 436/857] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:48 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:49.637873 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:49.638627 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:49.646152 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:49.647010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:49.648074 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:49.648717 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:49.758885 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:49.773512 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7e846258-b6d4-4197-b6d4-7b990c4debe8 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 200 len: 1471 microversion: 2.1 time: 0.139292 May 12 19:07:49.775442 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 422/858] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:49 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 1471 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:49.909108 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-b234abd1-bf60-45ed-acb0-84d0cfacfb79 req-d3c3d241-139d-4aa4-bc9c-83e17c8d289e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16717c9-58f5-44ba-b7a5-881db819a3db", "name": "network-vif-deleted", "tag": "450fe8c5-775f-4706-a48a-71d489c1b53d"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:49.922016 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b234abd1-bf60-45ed-acb0-84d0cfacfb79 req-d3c3d241-139d-4aa4-bc9c-83e17c8d289e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:49.922192 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-b234abd1-bf60-45ed-acb0-84d0cfacfb79 req-d3c3d241-139d-4aa4-bc9c-83e17c8d289e service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:49.935894 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-b234abd1-bf60-45ed-acb0-84d0cfacfb79 req-d3c3d241-139d-4aa4-bc9c-83e17c8d289e service nova] Creating event network-vif-deleted:450fe8c5-775f-4706-a48a-71d489c1b53d for instance a16717c9-58f5-44ba-b7a5-881db819a3db on hv-cinder-79575 May 12 19:07:49.941687 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-b234abd1-bf60-45ed-acb0-84d0cfacfb79 req-d3c3d241-139d-4aa4-bc9c-83e17c8d289e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037514 May 12 19:07:49.942296 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 437/859] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:07:49.949515 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:49.950176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:49.957265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:49.957843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:49.958634 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:49.959074 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:50.141450 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:50.149063 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c27ca7b0-8b3c-4594-ace1-e22b62fe2346 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.203368 May 12 19:07:50.150010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 423/860] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:49 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:50.794320 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:50.794977 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: a16717c9-58f5-44ba-b7a5-881db819a3db] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:50.804684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:50.805165 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:50.811864 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:50.812620 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:50.830907 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] HTTP exception thrown: Instance a16717c9-58f5-44ba-b7a5-881db819a3db could not be found. May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Request method failure captured: May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db HTTP/1.1 May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVq7Tuok7E0TyYvDChDzbRcusb-EBJgeQ8L-Q_O7svFD0kHrTeCLpWULFBf1SfGmSSPDfGJSmFLuGdcJSDwR8CuZgAITvRtHcgPnJAXkOnAZ77Tx0XKG8mWIID3uih5MxFdTR1lZJMrL0PdOZJTdfIOwPB5a2bycYAyT5AhzYjNT7zk May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 3ff6e876f1ec44939bebef28b7dac12b May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1047201443 May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:07:50.832990 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3ff6e876f1ec44939bebef28b7dac12b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3ff6e876f1ec44939bebef28b7dac12b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3ff6e876f1ec44939bebef28b7dac12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3ff6e876f1ec44939bebef28b7dac12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-VolumesSnapshotTestJSON-1047201443 May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 3ff6e876f1ec44939bebef28b7dac12b May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1047201443 May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-VolumesSnapshotTestJSON-1047201443-project May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 9e68f1722227477cbbacd4813cd4f4bc May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-VolumesSnapshotTestJSON-1047201443-project May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance a16717c9-58f5-44ba-b7a5-881db819a3db could not be found. May 12 19:07:50.834785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': 'a16717c9-58f5-44ba-b7a5-881db819a3db'} May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16717c9-58f5-44ba-b7a5-881db819a3db could not be found. May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:07:50.835758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16717c9-58f5-44ba-b7a5-881db819a3db could not be found. May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16717c9-58f5-44ba-b7a5-881db819a3db could not be found. May 12 19:07:50.837335 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:07:50.839766 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Returning 404 to user: Instance a16717c9-58f5-44ba-b7a5-881db819a3db could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:07:50.840835 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0bf87b35-02b7-43a6-959e-1ebd7369baa5 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db" status: 404 len: 111 microversion: 2.1 time: 0.051783 May 12 19:07:50.841596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 438/861] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:50 2022] GET /compute/v2.1/servers/a16717c9-58f5-44ba-b7a5-881db819a3db => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:07:51.173102 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:51.173831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:51.183108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:51.183108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:51.183108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:51.183108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:51.380077 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:51.387800 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d4c71690-9ca0-435b-b319-3578a5744e79 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.224454 May 12 19:07:51.388586 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 424/862] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:51 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:51.956796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-e90b26c0-37e4-4c00-99b4-5e5c8d67ece9 req-74489f3c-26cc-4cec-943a-36d773fd7ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7dad07-5489-481f-a88f-82935b3fd957", "tag": "97f6e958-fd7c-4499-8394-1885592a7817"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:07:51.965808 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-e90b26c0-37e4-4c00-99b4-5e5c8d67ece9 req-74489f3c-26cc-4cec-943a-36d773fd7ae2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:51.966248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-e90b26c0-37e4-4c00-99b4-5e5c8d67ece9 req-74489f3c-26cc-4cec-943a-36d773fd7ae2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:51.976738 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-e90b26c0-37e4-4c00-99b4-5e5c8d67ece9 req-74489f3c-26cc-4cec-943a-36d773fd7ae2 service nova] Creating event network-changed:97f6e958-fd7c-4499-8394-1885592a7817 for instance 0e7dad07-5489-481f-a88f-82935b3fd957 on hv-cinder-79575 May 12 19:07:51.981801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-e90b26c0-37e4-4c00-99b4-5e5c8d67ece9 req-74489f3c-26cc-4cec-943a-36d773fd7ae2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029011 May 12 19:07:51.982609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 439/863] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:07:52.404861 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:52.405984 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:52.412343 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:52.412795 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:52.413595 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:52.414038 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:52.546597 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:52.553737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dca84897-2796-41d8-8756-678e9e4e1096 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.152800 May 12 19:07:52.554300 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 425/864] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:52 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:53.571609 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:53.572309 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:53.578596 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:53.579045 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:53.579814 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:53.580248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:53.710439 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:53.718190 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-66c889e9-3b63-4bae-b62d-532cc9fab584 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.150736 May 12 19:07:53.718743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 440/865] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:53 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:54.738779 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:54.739507 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:54.746220 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:54.746663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:54.747425 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:54.747858 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:54.877519 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:54.884803 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e3b15fd1-aaa4-4da2-bf91-6225166d7849 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.153877 May 12 19:07:54.885351 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 426/866] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:54 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:55.901084 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:55.901759 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:55.908707 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:55.909158 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:55.909961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:55.910402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:56.035496 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:56.042831 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-2d50cc3a-41dd-4a1e-87c5-8912558393ae tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.145863 May 12 19:07:56.043395 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 441/867] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:55 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:57.059560 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:57.060211 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:57.067001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:57.067447 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:57.068206 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:57.068640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:57.198110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:57.205859 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-cfd9817a-15d7-4f27-b256-0e8c53fb4202 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.150069 May 12 19:07:57.206414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 427/868] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:57 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:58.222585 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:58.223209 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:58.229648 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:58.230100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:58.230869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:58.231310 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:58.366840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:58.374698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4169eca0-4f3b-4fc9-9595-4761e0a56a56 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.155927 May 12 19:07:58.375285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 442/869] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:58 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:07:59.392007 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:07:59.392559 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:07:59.398937 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:59.399646 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:59.400420 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:07:59.400865 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:07:59.525081 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:07:59.532863 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7f3e3df8-365a-4349-b4c5-72787593154c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.145301 May 12 19:07:59.533423 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 428/870] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:07:59 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:00.550130 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:00.550748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:00.556924 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:00.557364 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:00.558158 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:00.558594 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:00.691438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:00.698679 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bbe5950b-7027-4cef-a9bc-524329ae4015 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.152498 May 12 19:08:00.699234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 443/871] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:00 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:00.842595 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1070106584", "imageRef": "39de9f0b-031f-419a-a22b-bfb5caae82a5", "flavorRef": "452", "networks": [{"uuid": "2997f016-b318-4e70-8380-fdb20cba3a19"}]}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:00.893917 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] validate_networks() for [('2997f016-b318-4e70-8380-fdb20cba3a19', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:08:01.502902 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:08:01.503320 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:08:01.503791 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:08:01.504194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:08:01.504599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:08:01.512988 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:01.513428 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:01.514741 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:01.515174 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:01.531641 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Getting quotas for project 3ff6e876f1ec44939bebef28b7dac12b. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:08:01.535435 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Getting quotas for user 9e68f1722227477cbbacd4813cd4f4bc and project 3ff6e876f1ec44939bebef28b7dac12b. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:08:01.545796 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:08:01.547975 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39de9f0b-031f-419a-a22b-bfb5caae82a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:08:01.594227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9da46eb4-245a-4176-bd76-d6ec4da0cb22 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755998 May 12 19:08:01.594867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 429/872] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:08:01.605055 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1b19f96f-3736-4f80-835d-356e2e0851a3 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:01.605691 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1b19f96f-3736-4f80-835d-356e2e0851a3 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:01.658044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-1b19f96f-3736-4f80-835d-356e2e0851a3 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:01.664458 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1b19f96f-3736-4f80-835d-356e2e0851a3 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1219 microversion: 2.1 time: 0.063128 May 12 19:08:01.665024 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 444/873] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:01 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:01.715346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:01.715970 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:01.723156 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:01.723613 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:01.724385 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:01.724826 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:01.861789 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:01.869716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a535c372-853b-44b9-bed8-1bf34432046c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.158149 May 12 19:08:01.870457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 430/874] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:01 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:02.681559 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:02.682534 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:02.690381 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:02.691129 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:02.692670 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:02.693822 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:02.803635 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:02.812394 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a688690c-11e1-47ee-a700-32bf7f1d647b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1289 microversion: 2.1 time: 0.134647 May 12 19:08:02.813104 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 445/875] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:02 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:02.887787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:02.888416 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:02.895579 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:02.896035 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:02.896850 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:02.897279 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:03.115869 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:03.124543 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0f1f55d9-ece0-4d16-b235-a21a71387359 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.241014 May 12 19:08:03.134002 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 431/876] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:02 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:03.830040 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:03.830785 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:03.837092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:03.837664 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:03.838357 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:03.838796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:04.041986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:04.050541 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e55ec21c-f9b8-4d1d-9f7d-4a6649d2ec4b tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1319 microversion: 2.1 time: 0.224826 May 12 19:08:04.051340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 446/877] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:03 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:08:04.141971 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:04.143668 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:04.151147 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:04.151925 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:04.152710 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:04.153347 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:04.156158 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-ce22bf3a-d413-40c0-815f-c7a31579d853 req-73f7d578-ff36-4ecd-8042-a430013ec8cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e84ce4-8a42-48d9-bc86-589443c631c7", "tag": "117ccdcc-426f-4743-96f9-32f327398cdd"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:04.168173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ce22bf3a-d413-40c0-815f-c7a31579d853 req-73f7d578-ff36-4ecd-8042-a430013ec8cf service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:04.172285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ce22bf3a-d413-40c0-815f-c7a31579d853 req-73f7d578-ff36-4ecd-8042-a430013ec8cf service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:04.200837 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-ce22bf3a-d413-40c0-815f-c7a31579d853 req-73f7d578-ff36-4ecd-8042-a430013ec8cf service nova] Creating event network-changed:117ccdcc-426f-4743-96f9-32f327398cdd for instance d7e84ce4-8a42-48d9-bc86-589443c631c7 on hv-cinder-79575 May 12 19:08:04.207289 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-ce22bf3a-d413-40c0-815f-c7a31579d853 req-73f7d578-ff36-4ecd-8042-a430013ec8cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055899 May 12 19:08:04.207913 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 447/878] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:08:04.387952 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:04.395343 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-64f9c3cb-b0aa-439d-80e0-55961d7caed6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.257766 May 12 19:08:04.395982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 432/879] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:04 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:05.068791 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:05.069499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:05.075634 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:05.076086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:05.076853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:05.077294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:05.210941 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:05.218241 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-53006c8d-f1b1-4965-9262-e5a9cf61da78 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1319 microversion: 2.1 time: 0.154085 May 12 19:08:05.218821 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 448/880] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:05 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:05.413084 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:05.413653 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:05.420464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:05.420912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:05.421721 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:05.422162 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:05.597760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:05.605168 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-bc26b125-bc42-4d3c-9a1a-e7c79735ab27 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.196024 May 12 19:08:05.605771 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 433/881] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:05 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:06.079777 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-75fbd777-aa7f-4a4c-9a8d-57ec3ac52317 req-fdb832b5-8e5e-44b2-aeea-09eafb3f89ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7dad07-5489-481f-a88f-82935b3fd957", "name": "network-vif-plugged", "status": "completed", "tag": "97f6e958-fd7c-4499-8394-1885592a7817"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:06.088239 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-75fbd777-aa7f-4a4c-9a8d-57ec3ac52317 req-fdb832b5-8e5e-44b2-aeea-09eafb3f89ed service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:06.088689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-75fbd777-aa7f-4a4c-9a8d-57ec3ac52317 req-fdb832b5-8e5e-44b2-aeea-09eafb3f89ed service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:06.100127 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-75fbd777-aa7f-4a4c-9a8d-57ec3ac52317 req-fdb832b5-8e5e-44b2-aeea-09eafb3f89ed service nova] Creating event network-vif-plugged:97f6e958-fd7c-4499-8394-1885592a7817 for instance 0e7dad07-5489-481f-a88f-82935b3fd957 on hv-cinder-79575 May 12 19:08:06.104847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-75fbd777-aa7f-4a4c-9a8d-57ec3ac52317 req-fdb832b5-8e5e-44b2-aeea-09eafb3f89ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029204 May 12 19:08:06.105426 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 449/882] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:08:06.235179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:06.235749 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:06.241698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:06.242155 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:06.242922 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:06.243362 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:06.413642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:06.421014 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2c6dcc97-f05e-441e-b3b8-9ea5fa8db022 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1319 microversion: 2.1 time: 0.189749 May 12 19:08:06.421597 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 434/883] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:06 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:06.625881 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:06.625881 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:06.631590 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:06.632035 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:06.632807 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:06.633241 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:06.761753 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:06.769438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-02e25149-0c43-4b56-89d1-36cecaf4f85c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1265 microversion: 2.1 time: 0.150620 May 12 19:08:06.770026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 450/884] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:06 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:07.438348 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:07.439524 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:07.445503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:07.445975 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:07.446761 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:07.447258 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:07.576819 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:07.584096 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-82354a19-19ef-44b6-a703-71458d22e00a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1319 microversion: 2.1 time: 0.150422 May 12 19:08:07.584655 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 435/885] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:07 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:07.786059 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:07.786590 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:07.792839 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:07.793289 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:07.794072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:07.794507 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:07.928869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:07.936965 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ad4fd461-6fb9-49f7-a3bd-1c865f997d9c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1452 microversion: 2.1 time: 0.154742 May 12 19:08:07.937546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 451/886] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:07 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:07.953715 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:07.954335 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:07.960121 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:07.960593 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:07.961372 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:07.961836 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:08.098308 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:08.107316 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a5f086ec-8666-40e3-aaeb-2d6c503c2288 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1452 microversion: 2.1 time: 0.158019 May 12 19:08:08.108123 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 436/887] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:07 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:08:08.600207 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:08.600733 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:08.606475 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:08.606927 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:08.607715 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:08.608150 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:08.735693 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:08.744980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c36c07d5-d994-4c45-bc1b-784fe7b45f1a tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1319 microversion: 2.1 time: 0.148630 May 12 19:08:08.755224 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 452/888] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:08 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:09.762392 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:09.763108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:09.770027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:09.770475 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:09.771240 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:09.771673 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:09.899722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:09.906986 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-09406ad2-6a5f-41c6-8763-82f67f14e598 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1319 microversion: 2.1 time: 0.148435 May 12 19:08:09.907638 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 437/889] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:09 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:10.117312 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-7dfa144b-b62b-40d1-b36e-b30e28a8e6c0 req-689e4ba1-69a9-4398-be34-c723b7db7e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7dad07-5489-481f-a88f-82935b3fd957", "tag": "97f6e958-fd7c-4499-8394-1885592a7817"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:10.126322 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-7dfa144b-b62b-40d1-b36e-b30e28a8e6c0 req-689e4ba1-69a9-4398-be34-c723b7db7e4a service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:10.126760 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-7dfa144b-b62b-40d1-b36e-b30e28a8e6c0 req-689e4ba1-69a9-4398-be34-c723b7db7e4a service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:10.138969 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-7dfa144b-b62b-40d1-b36e-b30e28a8e6c0 req-689e4ba1-69a9-4398-be34-c723b7db7e4a service nova] Creating event network-changed:97f6e958-fd7c-4499-8394-1885592a7817 for instance 0e7dad07-5489-481f-a88f-82935b3fd957 on hv-cinder-79575 May 12 19:08:10.146469 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-afdb4cf0-9023-43be-b4b7-6d558d30783f req-7127ffc0-2df9-4e54-a76e-e997582c870c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e84ce4-8a42-48d9-bc86-589443c631c7", "name": "network-vif-plugged", "status": "completed", "tag": "117ccdcc-426f-4743-96f9-32f327398cdd"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:10.154381 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-7dfa144b-b62b-40d1-b36e-b30e28a8e6c0 req-689e4ba1-69a9-4398-be34-c723b7db7e4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040647 May 12 19:08:10.155054 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-afdb4cf0-9023-43be-b4b7-6d558d30783f req-7127ffc0-2df9-4e54-a76e-e997582c870c service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:10.155574 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-afdb4cf0-9023-43be-b4b7-6d558d30783f req-7127ffc0-2df9-4e54-a76e-e997582c870c service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:10.158236 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 453/890] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:08:10.171847 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-afdb4cf0-9023-43be-b4b7-6d558d30783f req-7127ffc0-2df9-4e54-a76e-e997582c870c service nova] Creating event network-vif-plugged:117ccdcc-426f-4743-96f9-32f327398cdd for instance d7e84ce4-8a42-48d9-bc86-589443c631c7 on hv-cinder-79575 May 12 19:08:10.177386 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-afdb4cf0-9023-43be-b4b7-6d558d30783f req-7127ffc0-2df9-4e54-a76e-e997582c870c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034354 May 12 19:08:10.178031 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 438/891] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:08:10.925083 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:10.926051 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:10.932416 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:10.932976 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:10.933911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:10.934423 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:11.071082 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:11.079640 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-46827a88-dd0c-426d-b35c-c90a557d4178 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1319 microversion: 2.1 time: 0.158811 May 12 19:08:11.080234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 454/892] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:10 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:12.101778 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:12.102650 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:12.109202 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:12.109691 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:12.110547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:12.110907 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:12.245724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:12.253040 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8cf721ee-ed83-42ef-9f63-302a8da99c91 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1509 microversion: 2.1 time: 0.159739 May 12 19:08:12.253620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 439/893] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:12 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:08:12.269768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c2789ba3-c483-4fa8-9dd9-b6f2548a6dae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "367a593d-8d1e-42ad-865e-534642559a49", "device": "/dev/sdb"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:12.270856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c2789ba3-c483-4fa8-9dd9-b6f2548a6dae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:12.276803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2789ba3-c483-4fa8-9dd9-b6f2548a6dae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:12.277247 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2789ba3-c483-4fa8-9dd9-b6f2548a6dae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:12.278041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2789ba3-c483-4fa8-9dd9-b6f2548a6dae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:12.278475 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c2789ba3-c483-4fa8-9dd9-b6f2548a6dae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:12.524550 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c2789ba3-c483-4fa8-9dd9-b6f2548a6dae tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "POST /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258364 May 12 19:08:12.525151 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 455/894] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 12 19:08:12 2022] POST /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:08:14.693106 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b28966a1-f981-4b8b-8430-335020bb060b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:14.694313 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b28966a1-f981-4b8b-8430-335020bb060b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:14.701218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b28966a1-f981-4b8b-8430-335020bb060b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:14.701753 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b28966a1-f981-4b8b-8430-335020bb060b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:14.702567 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b28966a1-f981-4b8b-8430-335020bb060b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:14.703010 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b28966a1-f981-4b8b-8430-335020bb060b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:14.775369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b28966a1-f981-4b8b-8430-335020bb060b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/action" status: 202 len: 0 microversion: 2.1 time: 0.086344 May 12 19:08:14.778301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 440/895] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:08:14 2022] POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:08:14.785974 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:14.786689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:14.793147 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:14.793658 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:14.795034 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:14.795475 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:15.006624 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:15.014689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-176f3b99-6628-4bbf-9ed0-e596488d3bf8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1751 microversion: 2.1 time: 0.233457 May 12 19:08:15.015266 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 456/896] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:14 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:16.036276 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:16.036928 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:16.043487 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:16.043956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:16.044775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:16.045220 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:16.187627 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:16.195599 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-125a5002-e91e-4ec4-946e-b25d02a8169d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.163596 May 12 19:08:16.196158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 441/897] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:16 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:17.213303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:17.214394 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:17.220679 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:17.221123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:17.221904 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:17.222374 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:17.362644 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:17.370396 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ee14d4ff-8f52-4c28-8ed8-b213d08c27a6 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.160899 May 12 19:08:17.370921 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 457/898] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:17 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:18.387431 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:18.388524 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:18.394849 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:18.395303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:18.396076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:18.396516 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:18.532509 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:18.540275 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-31e52048-fdc5-49e9-97e4-36c4bb67bcbb tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.156828 May 12 19:08:18.540841 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 442/899] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:18 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:19.557743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:19.558455 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:19.565378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:19.565868 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:19.566642 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:19.567086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:19.707830 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:19.715625 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f977dd9e-be06-47f7-8e07-c675530f731b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.161758 May 12 19:08:19.716199 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 458/900] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:19 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:20.732199 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:20.732820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:20.739886 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:20.740339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:20.741112 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:20.741597 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:20.884060 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:20.891840 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-36c9dd13-b5ff-4f34-9633-726904b8534f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.163607 May 12 19:08:20.892407 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 443/901] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:20 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:21.908714 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:21.909358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:21.915690 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:21.916136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:21.916900 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:21.917338 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:22.055682 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:22.063470 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-d08bdd9b-70c3-477f-8e32-3e367a544412 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.158648 May 12 19:08:22.064055 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 459/902] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:21 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:23.080190 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:23.080833 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:23.087112 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:23.087561 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:23.088320 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:23.088753 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:23.228422 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:23.236737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-10389148-ce43-46a2-a15f-3dfc66f57d83 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.160321 May 12 19:08:23.237228 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 444/903] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:23 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:24.253992 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:24.254601 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:24.260512 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:24.260958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:24.261835 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:24.262337 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:24.433770 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:24.442006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-88c6eb0f-7a91-4329-a324-03cf72402774 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.191780 May 12 19:08:24.442567 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 460/904] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:24 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:25.459149 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:25.459760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:25.466061 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:25.466504 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:25.467271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:25.467705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:25.609956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:25.617850 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-14634b72-9bbe-4352-a3f7-56852368d3e7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.162502 May 12 19:08:25.618427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 445/905] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:25 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:26.634996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:26.635636 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:26.642495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:26.642958 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:26.643732 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:26.644175 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:26.780245 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:26.787997 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-74fe05b1-0b45-434a-bf0c-bf50c241fadc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.156802 May 12 19:08:26.788564 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 461/906] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:26 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:27.804872 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:27.805399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:27.811844 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:27.812287 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:27.813059 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:27.813494 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:27.952424 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:27.960185 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3e63c180-e1eb-4c5a-913c-7fe666313908 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.159202 May 12 19:08:27.960746 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 446/907] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:27 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:28.977869 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:28.978494 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:28.985500 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:28.986023 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:28.986800 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:28.987242 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:29.122799 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:29.132131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8cc57eb2-44dc-452f-8f8b-3e7f08ff322b tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.158230 May 12 19:08:29.132697 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 462/908] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:28 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:30.149726 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:30.150481 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:30.157326 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:30.157820 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:30.158603 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:30.159041 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:30.385466 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:30.393234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ab99b8f4-4720-433c-a347-ce18c3c9c899 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.247709 May 12 19:08:30.393831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 447/909] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:30 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:31.411017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:31.411553 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:31.417864 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:31.418324 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:31.419099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:31.419543 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:31.556495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:31.564281 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-833845c9-df4a-47ab-85b2-82ee23849980 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.157189 May 12 19:08:31.564853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 463/910] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:31 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:31.800876 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:31.801373 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:31.807590 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:31.808037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:31.808825 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:31.809255 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:31.887301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lazy-loading 'services' on Instance uuid d7e84ce4-8a42-48d9-bc86-589443c631c7 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:08:31.955153 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d109cb8f-d359-4c96-9434-05f4f921ef41 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7/os-volume_attachments/367a593d-8d1e-42ad-865e-534642559a49" status: 202 len: 0 microversion: 2.1 time: 0.158077 May 12 19:08:31.955737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 448/911] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:08:31 2022] DELETE /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7/os-volume_attachments/367a593d-8d1e-42ad-865e-534642559a49 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:08:32.581017 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:32.581775 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:32.587920 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:32.588366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:32.589127 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:32.590369 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:32.732628 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:32.741135 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5f6b85eb-e4ad-4562-b3a5-ae4a39d80137 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.163922 May 12 19:08:32.741794 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 464/912] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:32 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:33.064602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:33.065218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:33.071322 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:33.071787 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:33.072528 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:33.072963 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:33.096989 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Going to try to terminate instance {{(pid=117101) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:08:33.168936 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-74682e1a-624e-4fdb-a559-ab99c9435736 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 204 len: 0 microversion: 2.1 time: 0.108055 May 12 19:08:33.172756 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 449/913] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:08:33 2022] DELETE /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:08:33.180271 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:33.180883 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:33.187471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:33.187923 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:33.188698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:33.189169 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:33.315994 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:33.323300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7e54eef0-04cb-433d-a2a5-ce1b191d5d09 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1515 microversion: 2.1 time: 0.148551 May 12 19:08:33.323889 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 465/914] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:33 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:33.759161 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:33.759855 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:33.766208 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:33.766653 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:33.767417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:33.767852 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:33.905027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:33.912926 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-cb72479e-2b24-42b4-b011-a8d8f6dd32f5 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.157961 May 12 19:08:33.913483 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 450/915] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:33 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:34.341558 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:34.342177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:34.348435 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:34.348911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:34.349703 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:34.350136 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:34.748425 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:34.755701 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-47ea91f3-af77-4de5-a015-56ad54fd878d tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1515 microversion: 2.1 time: 0.417970 May 12 19:08:34.756270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 466/916] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:34 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1515 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:34.929659 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:34.930282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:34.936502 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:34.936943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:34.937737 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:34.938174 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:35.104326 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:35.112638 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-223f3173-14c9-43bf-93cd-274583027b9d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.186778 May 12 19:08:35.113215 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 451/917] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:34 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:35.521605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-06c18d27-e2b8-44b4-b91f-13f3b891d0d2 req-308428ef-631e-4d0d-b496-9c91e9da21b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e84ce4-8a42-48d9-bc86-589443c631c7", "name": "network-vif-deleted", "tag": "117ccdcc-426f-4743-96f9-32f327398cdd"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:08:35.531704 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-06c18d27-e2b8-44b4-b91f-13f3b891d0d2 req-308428ef-631e-4d0d-b496-9c91e9da21b8 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:35.532143 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-06c18d27-e2b8-44b4-b91f-13f3b891d0d2 req-308428ef-631e-4d0d-b496-9c91e9da21b8 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:35.544260 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-06c18d27-e2b8-44b4-b91f-13f3b891d0d2 req-308428ef-631e-4d0d-b496-9c91e9da21b8 service nova] Creating event network-vif-deleted:117ccdcc-426f-4743-96f9-32f327398cdd for instance d7e84ce4-8a42-48d9-bc86-589443c631c7 on hv-cinder-79575 May 12 19:08:35.550234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-06c18d27-e2b8-44b4-b91f-13f3b891d0d2 req-308428ef-631e-4d0d-b496-9c91e9da21b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031928 May 12 19:08:35.550835 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 467/918] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:08:35.772134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:35.772747 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:35.778898 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:35.779350 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:35.780123 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:35.780557 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:35.811774 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:35.812154 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:35.812602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.objects.instance [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lazy-loading 'fault' on Instance uuid d7e84ce4-8a42-48d9-bc86-589443c631c7 {{(pid=117101) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:08:35.852029 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e68f1722227477cbbacd4813cd4f4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ff6e876f1ec44939bebef28b7dac12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:35.859233 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ebc1a1f1-d467-48c6-a101-15b762acac90 tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 200 len: 1309 microversion: 2.1 time: 0.090993 May 12 19:08:35.859801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 452/919] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:35 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:36.132126 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:36.132902 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:36.139915 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:36.140363 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:36.141189 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:36.141671 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:36.293684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:36.301385 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-139dfcd5-b03d-4e99-bb26-63b30746ff97 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.173695 May 12 19:08:36.301987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 468/920] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:36 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:36.876790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:36.877403 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] [instance: d7e84ce4-8a42-48d9-bc86-589443c631c7] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:36.883285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:36.883733 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:36.884494 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:36.884933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:36.898334 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] HTTP exception thrown: Instance d7e84ce4-8a42-48d9-bc86-589443c631c7 could not be found. May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Request method failure captured: May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 HTTP/1.1 May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVq7Tuok7E0TyYvDChDzbRcusb-EBJgeQ8L-Q_O7svFD0kHrTeCLpWULFBf1SfGmSSPDfGJSmFLuGdcJSDwR8CuZgAITvRtHcgPnJAXkOnAZ77Tx0XKG8mWIID3uih5MxFdTR1lZJMrL0PdOZJTdfIOwPB5a2bycYAyT5AhzYjNT7zk May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: 3ff6e876f1ec44939bebef28b7dac12b May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1047201443 May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:08:36.899985 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3ff6e876f1ec44939bebef28b7dac12b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3ff6e876f1ec44939bebef28b7dac12b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3ff6e876f1ec44939bebef28b7dac12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3ff6e876f1ec44939bebef28b7dac12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-VolumesSnapshotTestJSON-1047201443 May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: 3ff6e876f1ec44939bebef28b7dac12b May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1047201443 May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-VolumesSnapshotTestJSON-1047201443-project May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 9e68f1722227477cbbacd4813cd4f4bc May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-VolumesSnapshotTestJSON-1047201443-project May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance d7e84ce4-8a42-48d9-bc86-589443c631c7 could not be found. May 12 19:08:36.901384 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'd7e84ce4-8a42-48d9-bc86-589443c631c7'} May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e84ce4-8a42-48d9-bc86-589443c631c7 could not be found. May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:08:36.902234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e84ce4-8a42-48d9-bc86-589443c631c7 could not be found. May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e84ce4-8a42-48d9-bc86-589443c631c7 could not be found. May 12 19:08:36.903766 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:08:36.905176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] Returning 404 to user: Instance d7e84ce4-8a42-48d9-bc86-589443c631c7 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:08:36.905176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-7a043ba8-d627-4b69-8ee1-443411e3616e tempest-VolumesSnapshotTestJSON-1047201443 tempest-VolumesSnapshotTestJSON-1047201443-project] 10.222.0.48 "GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7" status: 404 len: 111 microversion: 2.1 time: 0.028571 May 12 19:08:36.905176 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 453/921] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:36 2022] GET /compute/v2.1/servers/d7e84ce4-8a42-48d9-bc86-589443c631c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:08:37.317379 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:37.318021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:37.324791 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:37.325237 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:37.326028 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:37.326547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:37.462799 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:37.471087 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-b6c2d1fd-e1c0-4ccf-90ee-fd47635e395d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.157514 May 12 19:08:37.471684 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 469/922] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:37 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:38.488092 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:38.488704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:38.495005 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:38.495452 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:38.496210 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:38.496648 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:38.636546 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:38.644329 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-696bf3ee-eb3e-4ed6-8dca-7fb52f1723ae tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1756 microversion: 2.1 time: 0.160052 May 12 19:08:38.644884 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 454/923] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:38 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:08:39.661953 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:08:39.662702 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:08:39.669054 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:39.669507 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:39.670293 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:08:39.670727 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:08:39.813748 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:08:39.823041 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c0384c70-3cff-40cb-8d2e-7dad61e5ccc7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1759 microversion: 2.1 time: 0.164896 May 12 19:08:39.823691 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 470/924] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:08:39 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:09.533112 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-ca5984bc-fac7-424e-be1e-9bd7531882d4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Action: 'create', calling method: .version_select at 0x7f38c23d4b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-987455745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDurnJRzxoZ6K1B0L2NFrqE6/nKXZBBnxL8Cs2+dQsY4gW/WwKVvMsedmvkh5g5Jz6blio1Yq6dMdeMb9zwBxBzHb8gohwZQ/BGrGoNlaQkChvs8nsl3TdyTr3j8aOUi4Q=="}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:09.547257 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-ca5984bc-fac7-424e-be1e-9bd7531882d4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Getting quotas for project 0565eaa27c9a44e18a307c563a51767f. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:09:09.551564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-ca5984bc-fac7-424e-be1e-9bd7531882d4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Getting quotas for user 07563e344f8c439ea8d2439c61729d95 and project 0565eaa27c9a44e18a307c563a51767f. Resources: {'key_pairs'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:09:09.575727 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-ca5984bc-fac7-424e-be1e-9bd7531882d4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.200634 May 12 19:09:09.576329 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 455/925] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 12 19:09:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:09:13.401044 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1779301403"}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:13.401755 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:13.414018 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:13.414546 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:13.415468 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:13.415973 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:13.558757 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.network.security_group_api [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Removing security group 80c9565a-db98-4c47-bbb4-f58067b13aa7 from port c55cf03b-d589-4c2a-9552-6206a1a5b978 May 12 19:09:13.995543 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-633e15e7-1ad7-49d5-9fb6-d6b1bcb451e8 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/action" status: 202 len: 0 microversion: 2.1 time: 0.599350 May 12 19:09:13.997094 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 471/926] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:09:13 2022] POST /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:09:14.013207 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-487426dc-1a6d-4323-b86f-367346e7fb8f req-4e38f9b6-9f6e-4d01-8d97-9fd23b29d938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be0dc2-dd8c-46a6-b325-a810b21708e0", "tag": "c55cf03b-d589-4c2a-9552-6206a1a5b978"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:14.044280 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-487426dc-1a6d-4323-b86f-367346e7fb8f req-4e38f9b6-9f6e-4d01-8d97-9fd23b29d938 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:14.045377 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-487426dc-1a6d-4323-b86f-367346e7fb8f req-4e38f9b6-9f6e-4d01-8d97-9fd23b29d938 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:14.066541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-487426dc-1a6d-4323-b86f-367346e7fb8f req-4e38f9b6-9f6e-4d01-8d97-9fd23b29d938 service nova] Creating event network-changed:c55cf03b-d589-4c2a-9552-6206a1a5b978 for instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 on hv-cinder-79575 May 12 19:09:14.075117 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-487426dc-1a6d-4323-b86f-367346e7fb8f req-4e38f9b6-9f6e-4d01-8d97-9fd23b29d938 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070161 May 12 19:09:14.078420 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 456/927] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:09:15.281652 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:15.283072 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:15.284570 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-250cc4b6-81fc-4aec-b180-f0c83e17c0e9 req-7cfe5559-4401-4685-902b-5d75cfb65dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be0dc2-dd8c-46a6-b325-a810b21708e0", "tag": "c55cf03b-d589-4c2a-9552-6206a1a5b978"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:15.292415 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:15.293559 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:15.293696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-250cc4b6-81fc-4aec-b180-f0c83e17c0e9 req-7cfe5559-4401-4685-902b-5d75cfb65dae service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:15.294221 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-250cc4b6-81fc-4aec-b180-f0c83e17c0e9 req-7cfe5559-4401-4685-902b-5d75cfb65dae service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:15.301137 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:15.302123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:15.314701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-250cc4b6-81fc-4aec-b180-f0c83e17c0e9 req-7cfe5559-4401-4685-902b-5d75cfb65dae service nova] Creating event network-changed:c55cf03b-d589-4c2a-9552-6206a1a5b978 for instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 on hv-cinder-79575 May 12 19:09:15.323998 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-250cc4b6-81fc-4aec-b180-f0c83e17c0e9 req-7cfe5559-4401-4685-902b-5d75cfb65dae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043846 May 12 19:09:15.328716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 457/928] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:09:15.430310 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lazy-loading 'services' on Instance uuid 59be0dc2-dd8c-46a6-b325-a810b21708e0 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:09:15.548853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c944c8e9-9e8f-442f-8e2f-9cdbd0d87762 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments/893649e4-e9d7-4154-900f-3d46d09d1881" status: 202 len: 0 microversion: 2.1 time: 0.272064 May 12 19:09:15.553232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 472/929] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:09:15 2022] DELETE /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments/893649e4-e9d7-4154-900f-3d46d09d1881 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:09:15.566614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c0766351-2d2c-41b9-867d-a71c5ff0b32f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:15.568108 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c0766351-2d2c-41b9-867d-a71c5ff0b32f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:15.577964 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c0766351-2d2c-41b9-867d-a71c5ff0b32f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:15.579957 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c0766351-2d2c-41b9-867d-a71c5ff0b32f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:15.580809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c0766351-2d2c-41b9-867d-a71c5ff0b32f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:15.581462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c0766351-2d2c-41b9-867d-a71c5ff0b32f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:15.623382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c0766351-2d2c-41b9-867d-a71c5ff0b32f tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067388 May 12 19:09:15.623956 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 458/930] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:09:15 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:09:16.635796 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-801df2b7-1eba-4e5b-9d63-ab7466593ffe tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:16.636887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-801df2b7-1eba-4e5b-9d63-ab7466593ffe tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:16.644774 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-801df2b7-1eba-4e5b-9d63-ab7466593ffe tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:16.645656 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-801df2b7-1eba-4e5b-9d63-ab7466593ffe tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:16.646827 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-801df2b7-1eba-4e5b-9d63-ab7466593ffe tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:16.647480 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-801df2b7-1eba-4e5b-9d63-ab7466593ffe tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:16.676815 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-801df2b7-1eba-4e5b-9d63-ab7466593ffe tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045902 May 12 19:09:16.677348 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 473/931] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 12 19:09:16 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 19:09:16.687303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:16.687818 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:16.694104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:16.694555 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:16.695318 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:16.695760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:16.771791 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] HTTP exception thrown: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 is not attached to volume 893649e4-e9d7-4154-900f-3d46d09d1881 May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Request method failure captured: May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: DELETE /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments/893649e4-e9d7-4154-900f-3d46d09d1881 HTTP/1.1 May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVrC-o--63fSrpb1E_dVuF8RsNd-H4TLhGiJTzGYkwaLA29mMjmqDhYkos2LS5PrAe3C86-3kVhv8aywoaYjIYWPKmQsMofBw2yKNOzkZ_RBIcnZdAl6R6o1lkAcwUmlZyPB1ezchEUU3Giog6y21-BLS0HXr1okX7UFCOMtO7-O9Qc May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: ac196e75b746478c8ca28495d0971916 May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-TestMinimumBasicScenario-509599418 May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:09:16.774242 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac196e75b746478c8ca28495d0971916", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac196e75b746478c8ca28495d0971916"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac196e75b746478c8ca28495d0971916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac196e75b746478c8ca28495d0971916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-TestMinimumBasicScenario-509599418 May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: ac196e75b746478c8ca28495d0971916 May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-TestMinimumBasicScenario-509599418 May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-TestMinimumBasicScenario-509599418-project May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 345b44fe3ae849fb8f0a529d33e64679 May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-TestMinimumBasicScenario-509599418-project May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:09:16.775981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 is not attached to volume 893649e4-e9d7-4154-900f-3d46d09d1881 May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'server_id': '59be0dc2-dd8c-46a6-b325-a810b21708e0', 'id': '893649e4-e9d7-4154-900f-3d46d09d1881'} May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 893649e4-e9d7-4154-900f-3d46d09d1881. May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:09:16.777172 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 is not attached to volume 893649e4-e9d7-4154-900f-3d46d09d1881 May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 is not attached to volume 893649e4-e9d7-4154-900f-3d46d09d1881 May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:16.778743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Returning 404 to user: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 is not attached to volume 893649e4-e9d7-4154-900f-3d46d09d1881 {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:09:16.780514 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d2e45e0d-7905-45b7-b804-f387a40b53ad tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments/893649e4-e9d7-4154-900f-3d46d09d1881" status: 404 len: 154 microversion: 2.1 time: 0.092406 May 12 19:09:16.780514 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 459/932] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 12 19:09:16 2022] DELETE /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0/os-volume_attachments/893649e4-e9d7-4154-900f-3d46d09d1881 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:09:17.913192 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:17.913741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:17.920094 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:17.921078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:17.921890 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:17.922333 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:17.948526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:09:18.022548 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-09676140-aa8c-4093-b945-fde702f87ecc tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 204 len: 0 microversion: 2.1 time: 0.112915 May 12 19:09:18.023131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 474/933] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:09:17 2022] DELETE /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:09:18.031417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:18.032032 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:18.038537 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:18.038982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:18.039746 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:18.040182 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:18.279588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:18.287456 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0453a07e-90ae-4ff0-9ddd-e9cb976158e1 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1553 microversion: 2.1 time: 0.259903 May 12 19:09:18.288014 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 460/934] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:18 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:19.306244 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:19.306953 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:19.314484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:19.314948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:19.315825 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:19.316274 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:19.499363 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:19.506801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-8c285291-2dd5-4d72-9de0-fd739eded6a7 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1553 microversion: 2.1 time: 0.204793 May 12 19:09:19.507380 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 475/935] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:19 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:20.453023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-a9020d89-34c1-4846-b33b-64666aaae490 req-174d15dc-7199-4e43-bf66-0ad4c0d8d4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59be0dc2-dd8c-46a6-b325-a810b21708e0", "name": "network-vif-deleted", "tag": "c55cf03b-d589-4c2a-9552-6206a1a5b978"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:20.463577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-a9020d89-34c1-4846-b33b-64666aaae490 req-174d15dc-7199-4e43-bf66-0ad4c0d8d4c7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:20.464032 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-a9020d89-34c1-4846-b33b-64666aaae490 req-174d15dc-7199-4e43-bf66-0ad4c0d8d4c7 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:20.476444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-a9020d89-34c1-4846-b33b-64666aaae490 req-174d15dc-7199-4e43-bf66-0ad4c0d8d4c7 service nova] Creating event network-vif-deleted:c55cf03b-d589-4c2a-9552-6206a1a5b978 for instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 on hv-cinder-79575 May 12 19:09:20.482399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-a9020d89-34c1-4846-b33b-64666aaae490 req-174d15dc-7199-4e43-bf66-0ad4c0d8d4c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032833 May 12 19:09:20.484197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 461/936] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:09:20.524159 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:20.524779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:20.531484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:20.531945 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:20.532729 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:20.533172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:20.595745 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '345b44fe3ae849fb8f0a529d33e64679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac196e75b746478c8ca28495d0971916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:20.603149 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bf36e432-54b2-4c94-946b-fae3806f4fb3 tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 200 len: 1343 microversion: 2.1 time: 0.082824 May 12 19:09:20.603726 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 476/937] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:20 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 1343 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:21.620731 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:21.621453 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] [instance: 59be0dc2-dd8c-46a6-b325-a810b21708e0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:21.628554 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:21.628999 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:21.629790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:21.630219 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:21.643721 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] HTTP exception thrown: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 could not be found. May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Request method failure captured: May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 HTTP/1.1 May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVrC-o--63fSrpb1E_dVuF8RsNd-H4TLhGiJTzGYkwaLA29mMjmqDhYkos2LS5PrAe3C86-3kVhv8aywoaYjIYWPKmQsMofBw2yKNOzkZ_RBIcnZdAl6R6o1lkAcwUmlZyPB1ezchEUU3Giog6y21-BLS0HXr1okX7UFCOMtO7-O9Qc May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: ac196e75b746478c8ca28495d0971916 May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-TestMinimumBasicScenario-509599418 May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:09:21.645306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac196e75b746478c8ca28495d0971916", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac196e75b746478c8ca28495d0971916"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac196e75b746478c8ca28495d0971916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac196e75b746478c8ca28495d0971916"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-TestMinimumBasicScenario-509599418 May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: ac196e75b746478c8ca28495d0971916 May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-TestMinimumBasicScenario-509599418 May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-TestMinimumBasicScenario-509599418-project May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: 345b44fe3ae849fb8f0a529d33e64679 May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-TestMinimumBasicScenario-509599418-project May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 could not be found. May 12 19:09:21.647075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '59be0dc2-dd8c-46a6-b325-a810b21708e0'} May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 could not be found. May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:09:21.647943 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 could not be found. May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 could not be found. May 12 19:09:21.650265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:09:21.651698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Returning 404 to user: Instance 59be0dc2-dd8c-46a6-b325-a810b21708e0 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:09:21.651698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5ed2e78a-c2c0-4866-aaad-d396332e726d tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0" status: 404 len: 111 microversion: 2.1 time: 0.030177 May 12 19:09:21.651698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 462/938] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:21 2022] GET /compute/v2.1/servers/59be0dc2-dd8c-46a6-b325-a810b21708e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:09:21.655619 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c2339855-fd6f-4e2e-be14-86218347454e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] Calling method '.version_select at 0x7f38c23a9dc0>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:21.672225 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c2339855-fd6f-4e2e-be14-86218347454e tempest-TestMinimumBasicScenario-509599418 tempest-TestMinimumBasicScenario-509599418-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-771332876" status: 202 len: 0 microversion: 2.1 time: 0.020684 May 12 19:09:21.672768 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 477/939] 10.222.0.48 () {58 vars in 1268 bytes} [Thu May 12 19:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-771332876 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:09:25.986633 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-418754398", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-987455745", "security_groups": [{"name": "tempest-secgroup-smoke-1078287299"}], "networks": [{"uuid": "d122d075-290b-49ee-9eef-c39637b82d8b"}], "block_device_mapping_v2": [{"uuid": "044eb7ea-5484-4b47-a20d-e6d441a60db5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:26.144494 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.network.neutron [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] validate_networks() for [('d122d075-290b-49ee-9eef-c39637b82d8b', None, None, None, None, None)] {{(pid=117101) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:09:26.774867 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Flavor limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:09:26.775287 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Image limits 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:09:26.775762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Flavor pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:09:26.776177 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Image pref 0:0:0 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:09:26.776585 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.virt.hardware [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117101) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:09:26.785940 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:26.786390 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:26.787193 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:26.787628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:26.804195 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Getting quotas for project 0565eaa27c9a44e18a307c563a51767f. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:09:26.808051 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.quota [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Getting quotas for user 07563e344f8c439ea8d2439c61729d95 and project 0565eaa27c9a44e18a307c563a51767f. Resources: {'ram', 'instances', 'cores'} {{(pid=117101) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:09:26.875521 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Going to run 1 instances... {{(pid=117101) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:09:26.877749 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='044eb7ea-5484-4b47-a20d-e6d441a60db5',volume_size=None,volume_type=None)] {{(pid=117101) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:09:27.013868 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9c5bbede-a5ae-4d2e-9945-a48faaffc467 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.031585 May 12 19:09:27.020537 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 463/940] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:09:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:09:27.025558 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4c75c66c-4fda-4e71-84fb-8bc81d001239 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:27.026329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4c75c66c-4fda-4e71-84fb-8bc81d001239 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:27.087292 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4c75c66c-4fda-4e71-84fb-8bc81d001239 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:27.095904 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4c75c66c-4fda-4e71-84fb-8bc81d001239 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1087 microversion: 2.1 time: 0.074180 May 12 19:09:27.100210 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 478/941] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:27 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:28.114301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:28.114859 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:28.129866 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:28.130050 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:28.131457 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:28.132072 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:28.219325 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:28.233423 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d84784af-9573-4c10-b90b-32047322e2dc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1203 microversion: 2.1 time: 0.124735 May 12 19:09:28.234609 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 464/942] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:28 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1203 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:29.251584 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:29.257329 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:29.263924 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:29.264395 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:29.265175 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:29.265758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:29.471366 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:29.479943 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7199646d-d3dc-4718-9da5-2c409dae16a8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.231443 May 12 19:09:29.480536 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 479/943] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:29 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:09:29.791098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-d9bb1a6f-a120-404a-92ca-68e4462a76c7 req-71bda328-7e26-4152-8361-6be0ff04aea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56181e6-91f4-4e4f-9f03-890e1b2945f8", "tag": "3d305158-0b61-4aee-bec0-3bb97bcb137b"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:29.808383 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d9bb1a6f-a120-404a-92ca-68e4462a76c7 req-71bda328-7e26-4152-8361-6be0ff04aea4 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:29.810232 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-d9bb1a6f-a120-404a-92ca-68e4462a76c7 req-71bda328-7e26-4152-8361-6be0ff04aea4 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:29.839812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-d9bb1a6f-a120-404a-92ca-68e4462a76c7 req-71bda328-7e26-4152-8361-6be0ff04aea4 service nova] Creating event network-changed:3d305158-0b61-4aee-bec0-3bb97bcb137b for instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 on hv-cinder-79575 May 12 19:09:29.847518 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-d9bb1a6f-a120-404a-92ca-68e4462a76c7 req-71bda328-7e26-4152-8361-6be0ff04aea4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060170 May 12 19:09:29.848566 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 465/944] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:09:30.497188 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:30.499223 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:30.505803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:30.506253 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:30.507022 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:30.507550 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:30.810371 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:30.821206 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3bd5d4f8-e101-46db-bf54-045014c1f4a1 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.327841 May 12 19:09:30.822174 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 480/945] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:30 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:31.838222 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:31.838914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:31.846819 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:31.847269 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:31.848042 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:31.848477 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:32.050075 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:32.057344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-95011a57-bdd0-437d-a4f3-b8079c4736b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.223390 May 12 19:09:32.058140 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 466/946] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:31 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:33.074006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:33.074622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:33.081438 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:33.081911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:33.082677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:33.083124 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:33.210588 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:33.217846 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-005b8eed-1762-4d11-ba70-aa8febf2c2b2 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.147677 May 12 19:09:33.218404 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 481/947] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:33 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:34.236068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:34.237101 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:34.243331 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:34.243775 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:34.244538 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:34.244963 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:34.371477 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:34.378696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-406aeb23-5b76-4bde-b676-c04a199f6fad tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.147668 May 12 19:09:34.379318 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 467/948] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:34 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:35.395464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:35.396015 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:35.402442 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:35.402887 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:35.403653 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:35.404094 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:35.540022 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:35.547378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0a30a66a-ad03-418b-9729-ce91a9fcb6ea tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.155809 May 12 19:09:35.548441 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 482/949] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:35 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:36.563649 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:36.564275 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:36.570672 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:36.571126 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:36.571918 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:36.572348 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:36.697548 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:36.704790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d13aea3d-5895-41de-a8f5-5006ce5bcba5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.144999 May 12 19:09:36.705364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 468/950] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:36 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:37.721846 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:37.722458 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:37.728721 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:37.729163 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:37.729961 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:37.730391 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:37.861049 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:37.868642 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0172ca73-f5f0-4a51-abe0-5080d5e1e375 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.151311 May 12 19:09:37.869203 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 483/951] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:37 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:38.885974 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:38.886596 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:38.892365 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:38.892814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:38.893608 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:38.894047 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:39.025025 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:39.032981 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-0f9432a1-4ff1-4a66-a4e8-c5c8fa6f5d60 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.151098 May 12 19:09:39.033639 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 469/952] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:38 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:09:40.049907 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:40.050518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:40.056751 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:40.057197 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:40.057987 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:40.058422 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:40.196304 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:40.203518 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-60b174d9-5d53-45a4-8d3f-e540cf2676a7 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.157953 May 12 19:09:40.204088 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 484/953] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:40 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:40.527941 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-3e9c352e-b4ad-43a8-9fe5-7ed2fcf92a91 req-1cd38fa2-3cf9-4046-8975-89d206c48351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56181e6-91f4-4e4f-9f03-890e1b2945f8", "name": "network-vif-plugged", "status": "completed", "tag": "3d305158-0b61-4aee-bec0-3bb97bcb137b"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:40.537127 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-3e9c352e-b4ad-43a8-9fe5-7ed2fcf92a91 req-1cd38fa2-3cf9-4046-8975-89d206c48351 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:40.537594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-3e9c352e-b4ad-43a8-9fe5-7ed2fcf92a91 req-1cd38fa2-3cf9-4046-8975-89d206c48351 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:40.551357 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-3e9c352e-b4ad-43a8-9fe5-7ed2fcf92a91 req-1cd38fa2-3cf9-4046-8975-89d206c48351 service nova] Creating event network-vif-plugged:3d305158-0b61-4aee-bec0-3bb97bcb137b for instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 on hv-cinder-79575 May 12 19:09:40.556379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-3e9c352e-b4ad-43a8-9fe5-7ed2fcf92a91 req-1cd38fa2-3cf9-4046-8975-89d206c48351 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 May 12 19:09:40.557068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 470/954] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:09:41.220023 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:41.221191 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:41.227528 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:41.227978 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:41.228744 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:41.229183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:41.354155 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:41.361447 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0394cf99-8cc0-43f7-8aca-a5e22325a0df tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1259 microversion: 2.1 time: 0.145237 May 12 19:09:41.362093 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 485/955] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:41 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:42.379801 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:42.380589 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:42.387014 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:42.387460 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:42.388235 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:42.388665 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:42.519873 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:42.527202 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-54ac79df-c575-48b4-9668-de5be7bf9c17 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1443 microversion: 2.1 time: 0.152854 May 12 19:09:42.527798 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 471/956] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:42 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:42.543332 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:09:42.543946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:09:42.549982 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:42.550436 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:42.551214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:42.551677 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:42.679045 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:09:42.686359 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9b06f409-5360-462d-812a-55fb08cf926e tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1443 microversion: 2.1 time: 0.146798 May 12 19:09:42.686932 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 486/957] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:09:42 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:09:44.763903 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-e3117855-8a53-4866-a3ae-69e4ca368a0d req-7c0d4c20-1cdd-45c4-9556-6bee4d981231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56181e6-91f4-4e4f-9f03-890e1b2945f8", "tag": "3d305158-0b61-4aee-bec0-3bb97bcb137b"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:09:44.772309 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-e3117855-8a53-4866-a3ae-69e4ca368a0d req-7c0d4c20-1cdd-45c4-9556-6bee4d981231 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:09:44.772910 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-e3117855-8a53-4866-a3ae-69e4ca368a0d req-7c0d4c20-1cdd-45c4-9556-6bee4d981231 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:09:44.784344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-e3117855-8a53-4866-a3ae-69e4ca368a0d req-7c0d4c20-1cdd-45c4-9556-6bee4d981231 service nova] Creating event network-changed:3d305158-0b61-4aee-bec0-3bb97bcb137b for instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 on hv-cinder-79575 May 12 19:09:44.789265 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-e3117855-8a53-4866-a3ae-69e4ca368a0d req-7c0d4c20-1cdd-45c4-9556-6bee4d981231 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029108 May 12 19:09:44.789912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 472/958] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:10:10.121848 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:10.122465 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:10.128907 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:10.129368 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:10.130215 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:10.130656 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:10.155099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:10:10.231311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-1c9681ab-5faa-4627-b995-e6e40cad6617 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 204 len: 0 microversion: 2.1 time: 0.112897 May 12 19:10:10.232001 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 487/959] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:10:10 2022] DELETE /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:10:10.241333 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:10.242076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:10.248385 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:10.248869 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:10.249814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:10.251482 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:10.382805 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:10.390134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-08e765b2-b3e6-414a-9d4c-29c5c75212bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1576 microversion: 2.1 time: 0.153519 May 12 19:10:10.390702 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 473/960] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:10 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:11.409105 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:11.409803 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:11.417005 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:11.417458 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:11.418257 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:11.418698 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:11.549469 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:11.557685 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-27502045-9ec7-4202-8094-0c25ef71e173 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1576 microversion: 2.1 time: 0.152919 May 12 19:10:11.558245 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 488/961] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:11 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:12.574992 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:12.575640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:12.581995 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:12.582449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:12.583222 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:12.583663 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:12.675369 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:12.682721 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-a16ba184-7070-4c10-b729-72d64b0172df tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 200 len: 1508 microversion: 2.1 time: 0.111616 May 12 19:10:12.683288 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 474/962] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:12 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 1508 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:12.860659 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-ff0ce440-b392-43d9-ac05-dbb189546eb4 req-ad110cba-e632-4792-bec5-10a7d1bf6df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7dad07-5489-481f-a88f-82935b3fd957", "name": "network-vif-deleted", "tag": "97f6e958-fd7c-4499-8394-1885592a7817"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:10:12.873555 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ff0ce440-b392-43d9-ac05-dbb189546eb4 req-ad110cba-e632-4792-bec5-10a7d1bf6df6 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:12.874010 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-ff0ce440-b392-43d9-ac05-dbb189546eb4 req-ad110cba-e632-4792-bec5-10a7d1bf6df6 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:12.887232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-ff0ce440-b392-43d9-ac05-dbb189546eb4 req-ad110cba-e632-4792-bec5-10a7d1bf6df6 service nova] Creating event network-vif-deleted:97f6e958-fd7c-4499-8394-1885592a7817 for instance 0e7dad07-5489-481f-a88f-82935b3fd957 on hv-cinder-79575 May 12 19:10:12.893340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-ff0ce440-b392-43d9-ac05-dbb189546eb4 req-ad110cba-e632-4792-bec5-10a7d1bf6df6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036456 May 12 19:10:12.894356 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 489/963] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:10:13.700008 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:13.700647 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:13.707635 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:13.708078 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:13.708942 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:13.709626 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:13.723762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] HTTP exception thrown: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Request method failure captured: May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 HTTP/1.1 May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVri7PWz4Qosl2Izt0-Vm4WsZmkQrqcvjGw_qacF7LFltv0SVIpGi4JtO3iDg1qSKxFiv2CcGijxJEhXPSFwLtuitgdON65t66g0cdt4rVzijdOjgdRLfi-uZNoP_qs3qF6ldHCJb3SqSrsJjhjEChHelEuCSD3d7Fmn1bDinHHq8oM May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:10:13.726790 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ab7dbf84e4d74021b021fbf20b99a7c9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-TestVolumeBootPattern-916975640 May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-TestVolumeBootPattern-916975640-project May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: dfae4bc82b774dc1bb8c98990b6a4ac7 May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-TestVolumeBootPattern-916975640-project May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:10:13.728584 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '0e7dad07-5489-481f-a88f-82935b3fd957'} May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:10:13.729651 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:10:13.731290 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:10:13.732642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Returning 404 to user: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:10:13.732642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-19cfe7d0-e1ae-4927-a233-88e9d03c03cc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 404 len: 111 microversion: 2.1 time: 0.032176 May 12 19:10:13.732642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 475/964] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:13 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:10:13.826428 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1965467807", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-417828809", "security_groups": [{"name": "tempest-secgroup-smoke-1462802288"}], "block_device_mapping_v2": [{"uuid": "9f023821-0069-43eb-8169-3aa3f37e1bdd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c023c40-b2da-44b2-b84e-b8fea4bf4942"}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:10:13.939650 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] validate_networks() for [('9c023c40-b2da-44b2-b84e-b8fea4bf4942', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:10:14.310130 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:10:14.310549 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:10:14.311021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:10:14.311423 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:10:14.311826 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:10:14.320809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:14.321255 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:14.322109 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:14.322633 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:14.338778 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:10:14.342617 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for user dfae4bc82b774dc1bb8c98990b6a4ac7 and project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:10:14.397669 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:10:14.399841 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f023821-0069-43eb-8169-3aa3f37e1bdd',volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:10:14.525363 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-46f5230d-e164-4021-9faa-27971c4e40bc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703177 May 12 19:10:14.526054 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 490/965] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:10:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:10:14.536086 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5fe6d2f8-7b40-428b-ae3d-e4727b774eba tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:14.536708 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5fe6d2f8-7b40-428b-ae3d-e4727b774eba tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:14.589008 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5fe6d2f8-7b40-428b-ae3d-e4727b774eba tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:14.595561 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5fe6d2f8-7b40-428b-ae3d-e4727b774eba tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1094 microversion: 2.1 time: 0.063516 May 12 19:10:14.596150 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 476/966] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:14 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:15.616378 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:15.616998 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:15.624772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:15.625227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:15.626036 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:15.626475 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:15.709353 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:15.716972 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-41ab1768-21b1-4ad6-bf0b-5c84290d1665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1200 microversion: 2.1 time: 0.106821 May 12 19:10:15.717579 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 491/967] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:15 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:16.734701 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:16.735302 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:16.742447 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:16.742904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:16.743743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:16.744227 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:16.957146 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:16.965222 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-237cae3d-6645-4299-a577-39bc870f41e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.234393 May 12 19:10:16.965900 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 477/968] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:16 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 19:10:17.256569 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-55963a30-9223-411d-93e1-fe7abb02f483 req-0b3163f5-6172-48ec-8f5a-bdd5e79456f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fdc9ab-c7f3-4675-8343-198ae514dee0", "tag": "4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:10:17.271187 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-55963a30-9223-411d-93e1-fe7abb02f483 req-0b3163f5-6172-48ec-8f5a-bdd5e79456f8 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:17.271769 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-55963a30-9223-411d-93e1-fe7abb02f483 req-0b3163f5-6172-48ec-8f5a-bdd5e79456f8 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:17.283741 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-55963a30-9223-411d-93e1-fe7abb02f483 req-0b3163f5-6172-48ec-8f5a-bdd5e79456f8 service nova] Creating event network-changed:4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a for instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 on hv-cinder-79575 May 12 19:10:17.289737 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-55963a30-9223-411d-93e1-fe7abb02f483 req-0b3163f5-6172-48ec-8f5a-bdd5e79456f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037019 May 12 19:10:17.290420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 492/969] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:10:17.985691 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:17.986617 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:17.995517 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:17.996057 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:17.996851 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:17.997297 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:18.230285 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:18.238104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-90151eab-1c2c-4456-b02d-3073e9d30c28 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.259196 May 12 19:10:18.238618 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 478/970] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:17 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:19.255724 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:19.256423 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:19.262576 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:19.263030 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:19.263798 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:19.264235 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:19.397928 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:19.405069 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-14b37085-c2f0-41b0-a2c8-0aa29a277e3c tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.153945 May 12 19:10:19.405650 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 493/971] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:19 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:20.422724 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:20.423271 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:20.430065 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:20.430523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:20.431288 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:20.431729 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:20.560650 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:20.567906 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-cd1702c3-aaee-4723-b214-81fbc131e3e8 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.149100 May 12 19:10:20.568480 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 479/972] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:20 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:21.584781 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:21.585996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:21.592286 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:21.592736 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:21.593503 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:21.593966 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:21.719008 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:21.726261 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-af710235-002b-4d37-881a-bf4a9783230b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.145391 May 12 19:10:21.726827 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 494/973] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:21 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:22.743344 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:22.743994 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:22.750315 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:22.750765 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:22.751532 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:22.751968 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:22.877104 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:22.885187 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f118f66c-bd30-4659-a7f5-0d22149ce665 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.145799 May 12 19:10:22.885799 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 480/974] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:22 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:23.902006 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:23.902623 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:23.909135 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:23.909797 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:23.910576 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:23.911021 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:24.041492 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:24.048885 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f9fe2b55-4bb6-4f10-8e45-3ba4ce3e8ffc tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.150707 May 12 19:10:24.049454 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 495/975] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:23 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:25.065760 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:25.066386 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:25.073429 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:25.073913 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:25.074722 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:25.075162 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:25.203463 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:25.211346 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-1c7da3ff-7745-4d16-aae9-333c287a3158 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.149565 May 12 19:10:25.211904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 481/976] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:25 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:26.228056 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:26.228806 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:26.235138 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:26.235587 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:26.236349 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:26.236788 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:26.363810 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:26.371707 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c5e9bbe0-1ee3-4e4a-8819-9d7e52e6fca9 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.147484 May 12 19:10:26.372270 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 496/977] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:26 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:27.388201 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:27.388819 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:27.395144 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:27.395601 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:27.396374 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:27.396817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:27.525135 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:27.532539 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c456ff05-1086-4255-9b73-eec4b74f2751 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.148187 May 12 19:10:27.533098 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 482/978] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:27 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:28.549463 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:28.550130 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:28.556974 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:28.557428 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:28.558229 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:28.558680 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:28.685419 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:28.692772 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4ab02811-6abc-4978-ae93-9918bab5ae78 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.147126 May 12 19:10:28.693338 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 497/979] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:28 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:28.940220 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-7c7bbf0c-d4f5-4f39-9727-73f368f9aaa7 req-92605d71-d8d9-43bd-9a1a-1a6680291b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fdc9ab-c7f3-4675-8343-198ae514dee0", "name": "network-vif-plugged", "status": "completed", "tag": "4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:10:28.948078 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-7c7bbf0c-d4f5-4f39-9727-73f368f9aaa7 req-92605d71-d8d9-43bd-9a1a-1a6680291b14 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:28.948523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-7c7bbf0c-d4f5-4f39-9727-73f368f9aaa7 req-92605d71-d8d9-43bd-9a1a-1a6680291b14 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:28.959247 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-7c7bbf0c-d4f5-4f39-9727-73f368f9aaa7 req-92605d71-d8d9-43bd-9a1a-1a6680291b14 service nova] Creating event network-vif-plugged:4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a for instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 on hv-cinder-79575 May 12 19:10:28.964169 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-7c7bbf0c-d4f5-4f39-9727-73f368f9aaa7 req-92605d71-d8d9-43bd-9a1a-1a6680291b14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143560 May 12 19:10:28.964745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 483/980] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:10:29.710042 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:29.711227 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:29.717484 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:29.717962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:29.718727 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:29.719162 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:29.846552 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:29.854269 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-a112b109-e89f-4d37-9cf5-2cbf2b6cc300 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1266 microversion: 2.1 time: 0.148044 May 12 19:10:29.854833 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 498/981] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:29 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:30.873602 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:30.874316 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:30.880743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:30.881194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:30.882026 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:30.882464 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:31.232762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:31.240151 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-59d09e71-3dee-4186-95a0-5dc4093998bb tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1454 microversion: 2.1 time: 0.371387 May 12 19:10:31.240804 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 484/982] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:30 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1454 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:31.256248 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:10:31.256868 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:10:31.263631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:31.264106 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:31.264866 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:31.265311 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:31.396183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:10:31.404101 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0e040bcf-325b-4486-bd64-a5a79818d89b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1454 microversion: 2.1 time: 0.151654 May 12 19:10:31.404670 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 499/983] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:10:31 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:10:33.102417 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-6ff3203c-bf07-4c93-81ba-419ebbd6e7ca req-3478499f-8aa7-41fa-bc03-940d46420735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fdc9ab-c7f3-4675-8343-198ae514dee0", "tag": "4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:10:33.110827 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-6ff3203c-bf07-4c93-81ba-419ebbd6e7ca req-3478499f-8aa7-41fa-bc03-940d46420735 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:10:33.111295 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-6ff3203c-bf07-4c93-81ba-419ebbd6e7ca req-3478499f-8aa7-41fa-bc03-940d46420735 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:10:33.123035 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-6ff3203c-bf07-4c93-81ba-419ebbd6e7ca req-3478499f-8aa7-41fa-bc03-940d46420735 service nova] Creating event network-changed:4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a for instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 on hv-cinder-79575 May 12 19:10:33.128444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-6ff3203c-bf07-4c93-81ba-419ebbd6e7ca req-3478499f-8aa7-41fa-bc03-940d46420735 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086006 May 12 19:10:33.128809 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 485/984] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:11:40.008462 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:11:40.009062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:40.015621 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:40.016077 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:40.016862 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:40.017303 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:40.039481 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.objects.instance [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lazy-loading 'flavor' on Instance uuid b56181e6-91f4-4e4f-9f03-890e1b2945f8 {{(pid=117102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 19:11:40.122526 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-0c248979-f0d0-4811-8f3c-134b52284398 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "POST /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8/action" status: 202 len: 0 microversion: 2.1 time: 0.118130 May 12 19:11:40.123120 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 500/985] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:11:40 2022] POST /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:11:40.133438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:40.134191 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:40.141076 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:40.141559 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:40.142339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:40.142765 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:40.275479 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:40.282871 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-e1f9de7d-c982-46e5-a7ad-96672ba211d8 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.155152 May 12 19:11:40.283432 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 486/986] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:40 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:41.301172 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:41.301905 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:41.308453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:41.308897 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:41.309689 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:41.310125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:41.440767 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:41.448400 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6c9ab978-d47b-408a-9d04-975dfe1d505d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.151452 May 12 19:11:41.448963 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 501/987] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:41 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:42.465405 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:42.466049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:42.472408 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:42.472856 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:42.473658 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:42.474097 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:42.598654 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:42.605921 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-851d102e-8f44-49f9-af13-1ed291027966 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.144319 May 12 19:11:42.606485 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 487/988] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:42 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:43.621725 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:43.622343 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:43.628420 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:43.628866 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:43.630210 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:43.630642 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:43.757833 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:43.765622 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-39467595-f89f-4969-9c8a-8b39450ecc1f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.147832 May 12 19:11:43.766183 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 502/989] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:43 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:44.783027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:44.783642 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:44.789959 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:44.790411 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:44.791178 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:44.791621 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:44.918292 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:44.925895 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9808238c-9ecf-4611-b78a-7e4861e83236 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.147350 May 12 19:11:44.926459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 488/990] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:44 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:45.942686 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:45.943295 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:45.949574 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:45.950024 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:45.950784 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:45.951220 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:46.080499 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:46.087900 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-49638f9c-fb69-4d60-8ad8-453abd22a6c5 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.149113 May 12 19:11:46.088469 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 503/991] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:45 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:47.105005 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:47.105641 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:47.112067 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:47.112511 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:47.113275 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:47.113746 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:47.240577 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:47.247806 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-8a849e16-9ac2-4c9f-819f-2e3904c6538f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.146714 May 12 19:11:47.248370 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 489/992] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:47 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:48.264454 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:48.265654 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:48.271840 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:48.272285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:48.273047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:48.273480 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:48.406123 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:48.413676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c078e6f1-20ee-46dc-8cfc-8bab14e280eb tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.153011 May 12 19:11:48.414249 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 504/993] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:48 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:49.429966 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:49.430588 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:49.438113 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:49.438563 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:49.439327 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:49.439762 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:49.567793 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:49.575083 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-246a9425-8283-4195-942d-6ebf649f389d tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.149017 May 12 19:11:49.575644 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 490/994] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:49 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:50.591824 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:50.592448 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:50.599403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:50.599854 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:50.600643 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:50.601074 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:51.083853 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:51.091168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-de5c73c9-6fc8-4206-bca4-a3bad8e5332a tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.503236 May 12 19:11:51.091739 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 505/995] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:50 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:52.108065 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:52.109194 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:52.115421 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:52.115866 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:52.116655 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:52.117090 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:52.252885 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:52.260273 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-5177010c-45b6-4f2a-beb5-97a0a56a781c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.156091 May 12 19:11:52.260817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 491/996] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:52 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:53.278340 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:53.278989 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:53.285836 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:53.286319 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:53.287358 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:53.287809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:53.420069 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:53.428193 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bf0402f3-67f8-4a69-94a5-c731e9ac08b4 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1569 microversion: 2.1 time: 0.153725 May 12 19:11:53.428758 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 506/997] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:53 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:53.444134 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:11:53.444723 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:53.451114 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:53.451788 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:53.452720 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:53.453339 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:53.526541 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [c07514f5-35b4-451a-8bd5-0408ebdfb01a] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 19:11:54.534427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [c07514f5-35b4-451a-8bd5-0408ebdfb01a] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 58826. May 12 19:11:54.538037 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-f2f4141b-19f1-4cf6-ab7a-e7d5ceca7f25 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "POST /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8/action" status: 202 len: 0 microversion: 2.1 time: 1.097792 May 12 19:11:54.538657 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 492/998] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 12 19:11:53 2022] POST /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:11:54.547451 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:54.549778 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:54.556267 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:54.556801 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:54.558099 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:54.558757 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:54.733498 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:54.741506 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-183a498d-9d10-40a9-b153-587600f013da tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1517 microversion: 2.1 time: 0.198728 May 12 19:11:54.742100 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 507/999] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:54 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:55.759547 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:55.760173 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:55.766259 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:55.766920 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:55.767704 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:55.768141 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:55.901459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:55.909620 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-d5b9a3d4-a55c-4750-9191-3146b1776147 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1519 microversion: 2.1 time: 0.154670 May 12 19:11:55.910189 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 493/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:55 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:56.926997 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:56.927551 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:56.933841 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:56.934294 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:56.935062 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:56.935502 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:57.062556 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:57.069735 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4ac68d9c-00b9-4964-a8bf-255a9f868ad9 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.146621 May 12 19:11:57.070302 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 508/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:56 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:57.196040 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-933ce932-610c-4c1c-9add-eeb1624017d8 req-5e149031-c3c6-4eca-ad2f-0fd55d7ed8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56181e6-91f4-4e4f-9f03-890e1b2945f8", "name": "network-vif-unplugged", "status": "completed", "tag": "3d305158-0b61-4aee-bec0-3bb97bcb137b"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:11:57.205716 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-933ce932-610c-4c1c-9add-eeb1624017d8 req-5e149031-c3c6-4eca-ad2f-0fd55d7ed8a2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:57.206266 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-933ce932-610c-4c1c-9add-eeb1624017d8 req-5e149031-c3c6-4eca-ad2f-0fd55d7ed8a2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:57.217777 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-933ce932-610c-4c1c-9add-eeb1624017d8 req-5e149031-c3c6-4eca-ad2f-0fd55d7ed8a2 service nova] Creating event network-vif-unplugged:3d305158-0b61-4aee-bec0-3bb97bcb137b for instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 on hv-cinder-79575 May 12 19:11:57.222897 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-933ce932-610c-4c1c-9add-eeb1624017d8 req-5e149031-c3c6-4eca-ad2f-0fd55d7ed8a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030662 May 12 19:11:57.223490 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 494/1002] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:11:58.087228 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:58.087855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:58.094267 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:58.094740 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:58.095500 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:58.095944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:58.227300 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:58.235141 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-9ae02cdd-72f7-4d0c-a2e3-9f2599302f45 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.151920 May 12 19:11:58.235711 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 509/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:58 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:11:59.252988 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:11:59.253763 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:11:59.260023 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:59.260477 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:59.261256 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:11:59.261728 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:11:59.392594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:11:59.399911 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9c37c75e-0dd0-4187-94b6-2d724239aaee tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.152256 May 12 19:11:59.400484 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 495/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:11:59 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:00.416610 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:00.417234 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:00.424743 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:00.425198 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:00.426004 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:00.426448 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:00.574177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:00.581427 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-26c91e2c-0d51-4dc2-a487-d790e2d6d4fc tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.168766 May 12 19:12:00.582015 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 510/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:00 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:01.598718 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:01.599327 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:01.605653 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:01.606097 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:01.606856 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:01.607292 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:01.736542 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:01.743803 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9f661819-4ff5-4dd5-aad7-d439f1483c35 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.148856 May 12 19:12:01.744303 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 496/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:01 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:02.760557 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:02.761167 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:02.768034 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:02.768417 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:02.769175 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:02.769636 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:02.897076 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:02.904350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ac9defc3-bba9-4d7b-8d68-7ae3a6ad0b47 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.147623 May 12 19:12:02.904912 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 511/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:02 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:03.923068 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:03.923700 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:03.929860 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:03.930549 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:03.931334 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:03.931770 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:04.063685 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:04.071230 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-56f76486-cfd9-4447-a74b-c70d16117a8f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.153825 May 12 19:12:04.071831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 497/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:03 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:05.088405 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:05.089026 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:05.095934 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:05.096390 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:05.097161 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:05.097645 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:05.388775 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:05.396632 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-dc9db3c4-8abc-41fe-9871-170114114406 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1575 microversion: 2.1 time: 0.312088 May 12 19:12:05.397199 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 512/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:05 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1575 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:06.414306 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:06.414875 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:06.421812 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:06.423040 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:06.423938 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:06.424449 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:06.558816 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:06.566115 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-c2a803a1-b576-4bf2-849b-a999e2ad4f1c tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1562 microversion: 2.1 time: 0.156284 May 12 19:12:06.566676 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 498/1010] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:06 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:07.130217 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1761670709", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-417828809", "security_groups": [{"name": "tempest-secgroup-smoke-1462802288"}], "block_device_mapping_v2": [{"uuid": "ce2c5ae2-c879-4848-8873-93b8b5b66f79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c023c40-b2da-44b2-b84e-b8fea4bf4942"}]}} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:12:07.241784 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.network.neutron [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] validate_networks() for [('9c023c40-b2da-44b2-b84e-b8fea4bf4942', None, None, None, None, None)] {{(pid=117102) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 19:12:07.336881 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-aaed735a-c0d6-42b5-be2e-99cfbb43328f req-43b8c9d5-efb6-49a4-a90f-949dad4a7018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56181e6-91f4-4e4f-9f03-890e1b2945f8", "name": "network-vif-plugged", "status": "completed", "tag": "3d305158-0b61-4aee-bec0-3bb97bcb137b"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:12:07.345908 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-aaed735a-c0d6-42b5-be2e-99cfbb43328f req-43b8c9d5-efb6-49a4-a90f-949dad4a7018 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:07.346441 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-aaed735a-c0d6-42b5-be2e-99cfbb43328f req-43b8c9d5-efb6-49a4-a90f-949dad4a7018 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:07.358022 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-aaed735a-c0d6-42b5-be2e-99cfbb43328f req-43b8c9d5-efb6-49a4-a90f-949dad4a7018 service nova] Creating event network-vif-plugged:3d305158-0b61-4aee-bec0-3bb97bcb137b for instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 on hv-cinder-79575 May 12 19:12:07.363784 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-aaed735a-c0d6-42b5-be2e-99cfbb43328f req-43b8c9d5-efb6-49a4-a90f-949dad4a7018 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030705 May 12 19:12:07.364615 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 499/1011] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:12:07.652045 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Flavor limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 19:12:07.652467 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Image limits 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 19:12:07.652942 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Flavor pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 19:12:07.653350 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Image pref 0:0:0 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 19:12:07.653860 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.virt.hardware [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 19:12:07.662704 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:07.663153 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:07.663964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:07.664400 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:07.680945 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 19:12:07.684781 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.quota [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Getting quotas for user dfae4bc82b774dc1bb8c98990b6a4ac7 and project ab7dbf84e4d74021b021fbf20b99a7c9. Resources: {'ram', 'instances', 'cores'} {{(pid=117102) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 19:12:07.739956 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Going to run 1 instances... {{(pid=117102) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 19:12:07.742061 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce2c5ae2-c879-4848-8873-93b8b5b66f79',volume_size=None,volume_type=None)] {{(pid=117102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 19:12:07.863113 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-5ea348ea-6df8-48cb-8791-061b5a377902 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736677 May 12 19:12:07.863737 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 513/1012] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 12 19:12:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 19:12:07.874119 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-971b6c2f-1ba7-4234-af28-1b84e21efad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:07.874821 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-971b6c2f-1ba7-4234-af28-1b84e21efad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:07.928596 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-971b6c2f-1ba7-4234-af28-1b84e21efad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:07.935435 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-971b6c2f-1ba7-4234-af28-1b84e21efad4 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1094 microversion: 2.1 time: 0.065513 May 12 19:12:07.936001 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 500/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:07 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:08.952471 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:08.953083 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:08.959162 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:08.959610 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:08.960375 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:08.960809 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:09.035430 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:09.043506 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7008751a-dbc0-4330-b961-9f1a6a9f355a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1210 microversion: 2.1 time: 0.095213 May 12 19:12:09.044078 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 514/1014] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:08 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:10.061684 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:10.062322 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:10.070881 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:10.071326 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:10.072110 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:10.072870 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:10.267021 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:10.274536 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-9754cc84-8cf1-4ff1-ba05-4230449f113a tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.216776 May 12 19:12:10.275097 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 501/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:10 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:10.319086 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-479f10bd-fb1f-4d56-8b3f-c48f800f02f0 req-94989d29-6c6a-46d7-84b9-6de00d6c5dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05c83c1-ae3c-4086-9d42-241aba63b44e", "tag": "8116eb5e-fbd0-450d-8c54-3f99c9c4c3de"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:12:10.330173 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-479f10bd-fb1f-4d56-8b3f-c48f800f02f0 req-94989d29-6c6a-46d7-84b9-6de00d6c5dde service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:10.330559 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-479f10bd-fb1f-4d56-8b3f-c48f800f02f0 req-94989d29-6c6a-46d7-84b9-6de00d6c5dde service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:10.341979 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-479f10bd-fb1f-4d56-8b3f-c48f800f02f0 req-94989d29-6c6a-46d7-84b9-6de00d6c5dde service nova] Creating event network-changed:8116eb5e-fbd0-450d-8c54-3f99c9c4c3de for instance b05c83c1-ae3c-4086-9d42-241aba63b44e on hv-cinder-79575 May 12 19:12:10.346973 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-479f10bd-fb1f-4d56-8b3f-c48f800f02f0 req-94989d29-6c6a-46d7-84b9-6de00d6c5dde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 May 12 19:12:10.347647 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 515/1016] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:12:11.293107 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:11.293764 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:11.300912 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:11.301362 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:11.302158 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:11.302601 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:11.509811 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:11.517187 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dd163503-0673-479e-b6a0-f4364d1c875b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.227932 May 12 19:12:11.517865 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 502/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:11 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:12.536856 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:12.537578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:12.544047 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:12.544629 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:12.545389 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:12.545854 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:12.676022 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:12.683397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-16e9e39f-2df0-4ccb-9625-ec20725444d3 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.152309 May 12 19:12:12.683949 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 516/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:12 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:13.699652 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:13.700297 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:13.706628 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:13.707080 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:13.707848 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:13.708282 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:13.833743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:13.841000 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2ff1ef3e-84d2-4876-84fa-64fdd1b7d190 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.145224 May 12 19:12:13.841578 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 503/1019] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:13 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:14.858246 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:14.858850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:14.865578 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:14.866027 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:14.866783 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:14.867214 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:14.999339 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:15.007125 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-ecd114d7-39bf-4331-bf2d-9e768ad2b822 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.152716 May 12 19:12:15.007681 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 517/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:14 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:16.024572 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:16.025188 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:16.031523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:16.032502 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:16.033272 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:16.033742 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:16.169427 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:16.177175 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-92768b9e-d1bc-4446-ab34-9eba67931a55 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.156538 May 12 19:12:16.177777 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 504/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:16 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:17.193500 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:17.194160 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:17.200492 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:17.200943 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:17.201753 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:17.202197 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:17.332482 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:17.339729 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-c24fefc6-f876-4860-9565-991fcb8ab0a6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.150147 May 12 19:12:17.340285 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 518/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:17 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:18.360942 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:18.362109 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:18.370376 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:18.370831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:18.371993 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:18.372438 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:18.504900 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:18.512364 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b3103511-e92a-447e-a0a4-e9fa6f4c6209 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.159347 May 12 19:12:18.512930 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 505/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:18 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:19.529642 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:19.530200 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:19.536602 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:19.537055 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:19.537849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:19.538292 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:19.665001 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:19.672232 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-769bb903-706c-4b0a-92a2-3353160d315f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.146562 May 12 19:12:19.672787 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 519/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:19 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:20.756028 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:20.756643 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:20.762575 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:20.763020 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:20.763785 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:20.764221 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:20.895237 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:20.902564 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-830db85a-a87a-485b-a69e-99e786dab5c6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.217187 May 12 19:12:20.903130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 506/1025] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:20 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:21.428254 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-4a8a1329-1739-4fe5-a895-292682b038ef req-90034be6-5004-4a56-aea7-14831e93b971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05c83c1-ae3c-4086-9d42-241aba63b44e", "name": "network-vif-plugged", "status": "completed", "tag": "8116eb5e-fbd0-450d-8c54-3f99c9c4c3de"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:12:21.437613 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-4a8a1329-1739-4fe5-a895-292682b038ef req-90034be6-5004-4a56-aea7-14831e93b971 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:21.438050 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-4a8a1329-1739-4fe5-a895-292682b038ef req-90034be6-5004-4a56-aea7-14831e93b971 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:21.450262 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-4a8a1329-1739-4fe5-a895-292682b038ef req-90034be6-5004-4a56-aea7-14831e93b971 service nova] Creating event network-vif-plugged:8116eb5e-fbd0-450d-8c54-3f99c9c4c3de for instance b05c83c1-ae3c-4086-9d42-241aba63b44e on hv-cinder-79575 May 12 19:12:21.455980 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-4a8a1329-1739-4fe5-a895-292682b038ef req-90034be6-5004-4a56-aea7-14831e93b971 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 May 12 19:12:21.456569 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 520/1026] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:12:21.919322 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:21.919933 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:21.926596 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:21.927046 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:21.927811 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:21.928251 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:22.057284 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:22.065362 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-644d02e0-5a77-4734-a007-34b2fe58d774 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.149892 May 12 19:12:22.065951 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 507/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:21 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:23.083309 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:23.084039 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:23.090727 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:23.091182 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:23.091952 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:23.092390 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:23.222779 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:23.232911 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-17c9c121-0642-48b4-b41f-0650a61ee2e6 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1266 microversion: 2.1 time: 0.153975 May 12 19:12:23.233545 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 521/1028] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:23 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:24.249180 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:24.249815 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:24.256909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:24.257353 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:24.258157 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:24.258590 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:24.390229 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:24.398267 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-99218a43-ca9d-48f7-a4ab-e54c1fd0aa95 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1453 microversion: 2.1 time: 0.152946 May 12 19:12:24.398844 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 508/1029] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:24 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:24.415255 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:12:24.415896 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:12:24.422177 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:24.422630 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:24.423392 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:24.423830 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:24.549573 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:12:24.556870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-bc36b87d-d84a-4bcf-a117-06eab3870531 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1453 microversion: 2.1 time: 0.145468 May 12 19:12:24.557431 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 522/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:12:24 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:12:26.445197 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-7c082f42-3ff0-4d8f-9860-1b631237f1a7 req-4f96b1f6-f47c-4264-a1ac-9914711f6592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05c83c1-ae3c-4086-9d42-241aba63b44e", "tag": "8116eb5e-fbd0-450d-8c54-3f99c9c4c3de"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:12:26.453586 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-7c082f42-3ff0-4d8f-9860-1b631237f1a7 req-4f96b1f6-f47c-4264-a1ac-9914711f6592 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:12:26.454096 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-7c082f42-3ff0-4d8f-9860-1b631237f1a7 req-4f96b1f6-f47c-4264-a1ac-9914711f6592 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:12:26.464720 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-7c082f42-3ff0-4d8f-9860-1b631237f1a7 req-4f96b1f6-f47c-4264-a1ac-9914711f6592 service nova] Creating event network-changed:8116eb5e-fbd0-450d-8c54-3f99c9c4c3de for instance b05c83c1-ae3c-4086-9d42-241aba63b44e on hv-cinder-79575 May 12 19:12:26.470953 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-7c082f42-3ff0-4d8f-9860-1b631237f1a7 req-4f96b1f6-f47c-4264-a1ac-9914711f6592 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028738 May 12 19:12:26.471633 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 509/1031] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:13:20.814572 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:13:20.815092 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:13:20.821874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:20.822397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:20.823244 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:20.823964 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:20.850944 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:13:20.896990 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-2dbde4b4-ee40-4a58-9acd-ac2ea073f044 req-6600619a-e299-4004-8be5-5c0b8de3d905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56181e6-91f4-4e4f-9f03-890e1b2945f8", "tag": "3d305158-0b61-4aee-bec0-3bb97bcb137b"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:13:20.905952 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-2dbde4b4-ee40-4a58-9acd-ac2ea073f044 req-6600619a-e299-4004-8be5-5c0b8de3d905 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:20.906825 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-2dbde4b4-ee40-4a58-9acd-ac2ea073f044 req-6600619a-e299-4004-8be5-5c0b8de3d905 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:20.920524 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-2dbde4b4-ee40-4a58-9acd-ac2ea073f044 req-6600619a-e299-4004-8be5-5c0b8de3d905 service nova] Creating event network-changed:3d305158-0b61-4aee-bec0-3bb97bcb137b for instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 on hv-cinder-79575 May 12 19:13:20.926817 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-2dbde4b4-ee40-4a58-9acd-ac2ea073f044 req-6600619a-e299-4004-8be5-5c0b8de3d905 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106293 May 12 19:13:20.927800 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 510/1032] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:13:20.936760 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-917b9d1c-571f-40cb-98f7-a7c47cf67e36 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 204 len: 0 microversion: 2.1 time: 0.125483 May 12 19:13:20.937846 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 523/1033] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:13:20 2022] DELETE /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:13:20.946994 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:13:20.947691 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:13:20.953822 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:20.954267 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:20.955027 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:20.955459 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:21.089196 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:13:21.096713 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-dd84ba21-de7b-4f4f-912a-d74005d5fb74 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.153779 May 12 19:13:21.097305 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 511/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:13:20 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:13:22.116258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:13:22.116996 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:13:22.123490 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:22.123884 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:22.124672 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:22.125114 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:22.292593 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:13:22.300000 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-10b49767-4a3c-4a1a-bc13-477589f6447f tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1568 microversion: 2.1 time: 0.188768 May 12 19:13:22.300560 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 524/1035] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:13:22 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:13:23.318379 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:13:23.319006 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:13:23.325202 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:23.325678 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:23.326455 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:23.326890 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:23.346907 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [req-57063e1a-49eb-4f3e-a663-5cadab28fa2e req-d1914f2b-0d27-4392-8e90-44bb599b90c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56181e6-91f4-4e4f-9f03-890e1b2945f8", "name": "network-vif-deleted", "tag": "3d305158-0b61-4aee-bec0-3bb97bcb137b"}]} {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:13:23.355011 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-57063e1a-49eb-4f3e-a663-5cadab28fa2e req-d1914f2b-0d27-4392-8e90-44bb599b90c2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:23.355451 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [req-57063e1a-49eb-4f3e-a663-5cadab28fa2e req-d1914f2b-0d27-4392-8e90-44bb599b90c2 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:23.367310 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.compute.server_external_events [req-57063e1a-49eb-4f3e-a663-5cadab28fa2e req-d1914f2b-0d27-4392-8e90-44bb599b90c2 service nova] Creating event network-vif-deleted:3d305158-0b61-4aee-bec0-3bb97bcb137b for instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 on hv-cinder-79575 May 12 19:13:23.373118 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [req-57063e1a-49eb-4f3e-a663-5cadab28fa2e req-d1914f2b-0d27-4392-8e90-44bb599b90c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029787 May 12 19:13:23.374194 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 525/1036] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:13:23.396300 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07563e344f8c439ea8d2439c61729d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0565eaa27c9a44e18a307c563a51767f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:13:23.403847 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-b680f38a-6a16-4715-9612-8c270d2ffb29 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 200 len: 1381 microversion: 2.1 time: 0.090042 May 12 19:13:23.404425 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 512/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:13:23 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 1381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:13:24.423371 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:13:24.423998 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] [instance: b56181e6-91f4-4e4f-9f03-890e1b2945f8] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:13:24.430862 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:24.431310 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:24.432079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:13:24.432516 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:13:24.446539 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] HTTP exception thrown: Instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 could not be found. May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Request method failure captured: May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 HTTP/1.1 May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVtQem7HFkdLn0Im208sQEiu3YH2vPxca1ClS819OA1m2T5xFcz1WPbTtACmJLzEwadELezi82RjonQDOJhNIsxxZg8_6wWwd7HijfqxV3XuoxtXRWhAqRBzG0kpzGsEPr_iTwEqUokp6G35LlVVl_xPOo70Gxstjp846uhqbyvkNdw May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: 0565eaa27c9a44e18a307c563a51767f May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-TestShelveInstance-170355146 May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:13:24.448179 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0565eaa27c9a44e18a307c563a51767f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0565eaa27c9a44e18a307c563a51767f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0565eaa27c9a44e18a307c563a51767f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0565eaa27c9a44e18a307c563a51767f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-TestShelveInstance-170355146 May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: 0565eaa27c9a44e18a307c563a51767f May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-TestShelveInstance-170355146 May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-TestShelveInstance-170355146-project May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: 07563e344f8c439ea8d2439c61729d95 May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-TestShelveInstance-170355146-project May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 could not be found. May 12 19:13:24.449938 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': 'b56181e6-91f4-4e4f-9f03-890e1b2945f8'} May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 could not be found. May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:13:24.450873 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 could not be found. May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 could not be found. May 12 19:13:24.452464 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:13:24.453986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Returning 404 to user: Instance b56181e6-91f4-4e4f-9f03-890e1b2945f8 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:13:24.453986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-54869544-dcfc-4eba-8c55-3599db6b5cbd tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8" status: 404 len: 111 microversion: 2.1 time: 0.031948 May 12 19:13:24.453986 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 526/1038] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:13:24 2022] GET /compute/v2.1/servers/b56181e6-91f4-4e4f-9f03-890e1b2945f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:13:24.611049 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-2e8e4b2f-b2f3-4956-ab06-7fbfd68bd864 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] Calling method '.version_select at 0x7f38c25834c0>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:13:24.628268 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-2e8e4b2f-b2f3-4956-ab06-7fbfd68bd864 tempest-TestShelveInstance-170355146 tempest-TestShelveInstance-170355146-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-987455745" status: 202 len: 0 microversion: 2.1 time: 0.021028 May 12 19:13:24.629381 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 513/1039] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 12 19:13:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-987455745 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:14:06.135696 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:06.136268 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:06.138800 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-4b97d2c6-de55-42af-8171-ba3b5a051454 req-40810ff2-2840-4bfe-9bc4-ab848df1b384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05c83c1-ae3c-4086-9d42-241aba63b44e", "tag": "8116eb5e-fbd0-450d-8c54-3f99c9c4c3de"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:14:06.142811 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:06.143364 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:06.144211 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:06.144706 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:06.147689 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-4b97d2c6-de55-42af-8171-ba3b5a051454 req-40810ff2-2840-4bfe-9bc4-ab848df1b384 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:06.148458 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-4b97d2c6-de55-42af-8171-ba3b5a051454 req-40810ff2-2840-4bfe-9bc4-ab848df1b384 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:06.158705 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-4b97d2c6-de55-42af-8171-ba3b5a051454 req-40810ff2-2840-4bfe-9bc4-ab848df1b384 service nova] Creating event network-changed:8116eb5e-fbd0-450d-8c54-3f99c9c4c3de for instance b05c83c1-ae3c-4086-9d42-241aba63b44e on hv-cinder-79575 May 12 19:14:06.163914 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-4b97d2c6-de55-42af-8171-ba3b5a051454 req-40810ff2-2840-4bfe-9bc4-ab848df1b384 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030159 May 12 19:14:06.168196 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 514/1040] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:14:06.172272 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:14:06.256435 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-44648017-3f91-4aae-81d4-5ecf19bdb59e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 204 len: 0 microversion: 2.1 time: 0.125223 May 12 19:14:06.258394 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 527/1041] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:14:06 2022] DELETE /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:14:06.267708 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:06.268412 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:06.274906 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:06.275354 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:06.276129 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:06.276560 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:06.407976 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:14:06.418025 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-04a3405a-3b87-4d78-904d-1dce5fb4a9d5 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1578 microversion: 2.1 time: 0.155241 May 12 19:14:06.418606 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 515/1042] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:06 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:14:07.436280 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:07.436985 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:07.443203 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:07.443661 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:07.444962 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:07.445398 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:07.613153 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:14:07.621077 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-e93382ac-5f92-4693-8e94-c292b2f46c83 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1578 microversion: 2.1 time: 0.188959 May 12 19:14:07.621721 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 528/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:07 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:14:08.477710 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-4ad27315-34f3-4e20-a74b-87a2b516c660 req-8d795cec-ec1d-407e-b3cc-9284f22926df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05c83c1-ae3c-4086-9d42-241aba63b44e", "name": "network-vif-deleted", "tag": "8116eb5e-fbd0-450d-8c54-3f99c9c4c3de"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:14:08.486529 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-4ad27315-34f3-4e20-a74b-87a2b516c660 req-8d795cec-ec1d-407e-b3cc-9284f22926df service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:08.486976 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-4ad27315-34f3-4e20-a74b-87a2b516c660 req-8d795cec-ec1d-407e-b3cc-9284f22926df service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:08.498218 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-4ad27315-34f3-4e20-a74b-87a2b516c660 req-8d795cec-ec1d-407e-b3cc-9284f22926df service nova] Creating event network-vif-deleted:8116eb5e-fbd0-450d-8c54-3f99c9c4c3de for instance b05c83c1-ae3c-4086-9d42-241aba63b44e on hv-cinder-79575 May 12 19:14:08.503245 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-4ad27315-34f3-4e20-a74b-87a2b516c660 req-8d795cec-ec1d-407e-b3cc-9284f22926df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029959 May 12 19:14:08.503832 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 516/1044] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:14:08.638605 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:08.639166 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:08.645421 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:08.645903 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:08.646678 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:08.647153 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:08.706870 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:14:08.714849 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-7c633717-b1d3-4d8b-8a88-3d4e2d5cef8e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 200 len: 1225 microversion: 2.1 time: 0.080196 May 12 19:14:08.715410 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 529/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:08 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:14:09.733406 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:09.734141 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: b05c83c1-ae3c-4086-9d42-241aba63b44e] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:09.740234 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:09.740684 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:09.741445 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:09.741909 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:09.754814 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] HTTP exception thrown: Instance b05c83c1-ae3c-4086-9d42-241aba63b44e could not be found. May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Request method failure captured: May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e HTTP/1.1 May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVri7PWz4Qosl2Izt0-Vm4WsZmkQrqcvjGw_qacF7LFltv0SVIpGi4JtO3iDg1qSKxFiv2CcGijxJEhXPSFwLtuitgdON65t66g0cdt4rVzijdOjgdRLfi-uZNoP_qs3qF6ldHCJb3SqSrsJjhjEChHelEuCSD3d7Fmn1bDinHHq8oM May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:14:09.756444 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ab7dbf84e4d74021b021fbf20b99a7c9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-TestVolumeBootPattern-916975640 May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: dfae4bc82b774dc1bb8c98990b6a4ac7 May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance b05c83c1-ae3c-4086-9d42-241aba63b44e could not be found. May 12 19:14:09.758301 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'b05c83c1-ae3c-4086-9d42-241aba63b44e'} May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05c83c1-ae3c-4086-9d42-241aba63b44e could not be found. May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:14:09.759340 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05c83c1-ae3c-4086-9d42-241aba63b44e could not be found. May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05c83c1-ae3c-4086-9d42-241aba63b44e could not be found. May 12 19:14:09.761160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:09.762614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Returning 404 to user: Instance b05c83c1-ae3c-4086-9d42-241aba63b44e could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:14:09.762614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-656b9118-61c1-4f82-b092-6c88aa82255e tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e" status: 404 len: 111 microversion: 2.1 time: 0.029051 May 12 19:14:09.762614 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 517/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:09 2022] GET /compute/v2.1/servers/b05c83c1-ae3c-4086-9d42-241aba63b44e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:14:12.808608 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:12.809170 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:12.810133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-79f9bc78-2e7d-487f-a734-3a2629862ec8 req-0fed00f5-f25f-40c4-9206-732483256708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fdc9ab-c7f3-4675-8343-198ae514dee0", "tag": "4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:14:12.815547 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:12.816061 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:12.816896 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:12.817397 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:12.818297 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-79f9bc78-2e7d-487f-a734-3a2629862ec8 req-0fed00f5-f25f-40c4-9206-732483256708 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:12.818745 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-79f9bc78-2e7d-487f-a734-3a2629862ec8 req-0fed00f5-f25f-40c4-9206-732483256708 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:12.830523 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-79f9bc78-2e7d-487f-a734-3a2629862ec8 req-0fed00f5-f25f-40c4-9206-732483256708 service nova] Creating event network-changed:4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a for instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 on hv-cinder-79575 May 12 19:14:12.836513 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-79f9bc78-2e7d-487f-a734-3a2629862ec8 req-0fed00f5-f25f-40c4-9206-732483256708 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029984 May 12 19:14:12.837305 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 518/1047] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 19:14:12.842959 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Going to try to terminate instance {{(pid=117102) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 19:14:12.926384 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-f246e167-9c22-4626-9218-0c6f8cb03985 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 204 len: 0 microversion: 2.1 time: 0.121995 May 12 19:14:12.927331 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 530/1048] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:14:12 2022] DELETE /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 19:14:12.936419 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:12.936649 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:12.943535 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:12.944017 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:12.944804 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:12.945244 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:13.078735 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.policy [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117101) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:14:13.086743 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3a707129-ffd6-44af-a6c7-efea9dafe197 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1578 microversion: 2.1 time: 0.155024 May 12 19:14:13.087313 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 519/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:12 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:14:14.105081 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:14.105933 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:14.112229 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:14.112631 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:14.113403 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:14.113880 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:14.315298 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:14:14.322551 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-efd90f49-fe1b-4101-94d3-f0512d9e0735 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1578 microversion: 2.1 time: 0.222235 May 12 19:14:14.323105 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 531/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:14 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:14:15.057843 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [req-1aa33385-c659-459f-b916-6bf99b94f776 req-0be84343-fd12-41e6-8c5a-b259e8de5540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fdc9ab-c7f3-4675-8343-198ae514dee0", "name": "network-vif-deleted", "tag": "4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a"}]} {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 19:14:15.066359 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-1aa33385-c659-459f-b916-6bf99b94f776 req-0be84343-fd12-41e6-8c5a-b259e8de5540 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:15.066810 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [req-1aa33385-c659-459f-b916-6bf99b94f776 req-0be84343-fd12-41e6-8c5a-b259e8de5540 service nova] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:15.078462 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.compute.server_external_events [req-1aa33385-c659-459f-b916-6bf99b94f776 req-0be84343-fd12-41e6-8c5a-b259e8de5540 service nova] Creating event network-vif-deleted:4d3e53a5-32f6-4016-99bf-5b4ec1c0f18a for instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 on hv-cinder-79575 May 12 19:14:15.083569 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [req-1aa33385-c659-459f-b916-6bf99b94f776 req-0be84343-fd12-41e6-8c5a-b259e8de5540 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030320 May 12 19:14:15.084275 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 520/1051] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 12 19:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 19:14:15.340543 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:15.341318 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:15.347521 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:15.348168 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:15.349347 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:15.350104 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:15.415847 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.policy [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfae4bc82b774dc1bb8c98990b6a4ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7dbf84e4d74021b021fbf20b99a7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117102) authorize /opt/stack/nova/nova/policy.py:199}} May 12 19:14:15.425874 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-6b24cecc-dcfb-4824-a7d1-7380d95b7d7b tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 200 len: 1225 microversion: 2.1 time: 0.089113 May 12 19:14:15.426453 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 532/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:15 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 19:14:16.444142 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:16.444831 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: c4fdc9ab-c7f3-4675-8343-198ae514dee0] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:16.450947 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:16.451399 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:16.452160 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:16.452594 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:16.465910 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] HTTP exception thrown: Instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 could not be found. May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Request method failure captured: May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 HTTP/1.1 May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVri7PWz4Qosl2Izt0-Vm4WsZmkQrqcvjGw_qacF7LFltv0SVIpGi4JtO3iDg1qSKxFiv2CcGijxJEhXPSFwLtuitgdON65t66g0cdt4rVzijdOjgdRLfi-uZNoP_qs3qF6ldHCJb3SqSrsJjhjEChHelEuCSD3d7Fmn1bDinHHq8oM May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:14:16.467503 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ab7dbf84e4d74021b021fbf20b99a7c9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: dfae4bc82b774dc1bb8c98990b6a4ac7 May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 could not be found. May 12 19:14:16.469130 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': 'c4fdc9ab-c7f3-4675-8343-198ae514dee0'} May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 could not be found. May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:14:16.470171 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 could not be found. May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 could not be found. May 12 19:14:16.471696 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.473103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Returning 404 to user: Instance c4fdc9ab-c7f3-4675-8343-198ae514dee0 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:14:16.473103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-100acda7-cd1d-4856-b4f5-27d81c4a25c1 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0" status: 404 len: 111 microversion: 2.1 time: 0.029341 May 12 19:14:16.473103 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 521/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:16 2022] GET /compute/v2.1/servers/c4fdc9ab-c7f3-4675-8343-198ae514dee0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:14:16.908492 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:16.909008 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.compute.api [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117102) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:16.916495 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:16.916948 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:16.917766 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:16.918207 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG oslo_concurrency.lockutils [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:16.931433 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.wsgi [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] HTTP exception thrown: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Request method failure captured: May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: request: DELETE /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 HTTP/1.1 May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept: application/json May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Accept-Encoding: identity May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Connection: close May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Length: 0 May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Content-Type: application/json May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Host: 10.222.0.48 May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Openstack-System-Scope: None May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: User-Agent: python-urllib3/1.26.9 May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Auth-Token: gAAAAABifVri7PWz4Qosl2Izt0-Vm4WsZmkQrqcvjGw_qacF7LFltv0SVIpGi4JtO3iDg1qSKxFiv2CcGijxJEhXPSFwLtuitgdON65t66g0cdt4rVzijdOjgdRLfi-uZNoP_qs3qF6ldHCJb3SqSrsJjhjEChHelEuCSD3d7Fmn1bDinHHq8oM May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Id: None May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Domain-Name: None May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Identity-Status: Confirmed May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Is-Admin-Project: True May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Id: default May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Domain-Name: Default May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Project-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Role: member,reader May 12 19:14:16.933131 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Roles: member,reader May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ab7dbf84e4d74021b021fbf20b99a7c9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-Tenant-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Id: default May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Domain-Name: Default May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Id: dfae4bc82b774dc1bb8c98990b6a4ac7 May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: X-User-Name: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: method: > May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: exception: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.934946 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: action_args: {'id': '0e7dad07-5489-481f-a88f-82935b3fd957'} May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:14:16.936079 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.937676 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR nova.api.openstack.wsgi May 12 19:14:16.939327 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Returning 404 to user: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. {{(pid=117102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:14:16.939327 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-4fc8a9d2-03c7-4c88-886c-d3c41b780388 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 404 len: 111 microversion: 2.1 time: 0.030074 May 12 19:14:16.939327 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 533/1054] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 12 19:14:16 2022] DELETE /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:14:16.943133 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '>' {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:16.943748 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.compute.api [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [instance: 0e7dad07-5489-481f-a88f-82935b3fd957] Fetching instance by UUID {{(pid=117101) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 19:14:16.951179 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:16.951640 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:16.952423 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 19:14:16.952906 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG oslo_concurrency.lockutils [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Lock "9c29fec8-2219-4b87-8182-3dbdeb30f262" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 19:14:16.967904 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.wsgi [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] HTTP exception thrown: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Request method failure captured: May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: request: GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 HTTP/1.1 May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept: application/json May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Accept-Encoding: identity May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Connection: close May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Length: 0 May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Content-Type: application/json May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Host: 10.222.0.48 May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Openstack-System-Scope: None May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: User-Agent: python-urllib3/1.26.9 May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Auth-Token: gAAAAABifVri7PWz4Qosl2Izt0-Vm4WsZmkQrqcvjGw_qacF7LFltv0SVIpGi4JtO3iDg1qSKxFiv2CcGijxJEhXPSFwLtuitgdON65t66g0cdt4rVzijdOjgdRLfi-uZNoP_qs3qF6ldHCJb3SqSrsJjhjEChHelEuCSD3d7Fmn1bDinHHq8oM May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Id: None May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Domain-Name: None May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Identity-Status: Confirmed May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Is-Admin-Project: True May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Id: default May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Domain-Name: Default May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Project-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Role: member,reader May 12 19:14:16.969414 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Roles: member,reader May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ab7dbf84e4d74021b021fbf20b99a7c9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab7dbf84e4d74021b021fbf20b99a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Id: ab7dbf84e4d74021b021fbf20b99a7c9 May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-Tenant-Name: tempest-TestVolumeBootPattern-916975640 May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Id: default May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Domain-Name: Default May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Id: dfae4bc82b774dc1bb8c98990b6a4ac7 May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: X-User-Name: tempest-TestVolumeBootPattern-916975640-project May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: method: > May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: exception: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.971064 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: action_args: {'id': '0e7dad07-5489-481f-a88f-82935b3fd957'} May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: {{(pid=117101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 19:14:16.972143 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. May 12 19:14:16.973698 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: ERROR nova.api.openstack.wsgi May 12 19:14:16.975338 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: DEBUG nova.api.openstack.wsgi [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Returning 404 to user: Instance 0e7dad07-5489-481f-a88f-82935b3fd957 could not be found. {{(pid=117101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 19:14:16.975338 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO nova.api.openstack.requestlog [None req-3c7aa545-94a5-4d62-a968-f18f2b46963f tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957" status: 404 len: 111 microversion: 2.1 time: 0.031598 May 12 19:14:16.975338 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: [pid: 117101|app: 0|req: 522/1055] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 12 19:14:16 2022] GET /compute/v2.1/servers/0e7dad07-5489-481f-a88f-82935b3fd957 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 19:14:18.246258 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: DEBUG nova.api.openstack.wsgi [None req-3e119b0c-19c6-41c3-ad14-ecdea3181455 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] Calling method '.version_select at 0x7f38c23de310>' {{(pid=117102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 19:14:18.249402 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e119b0c-19c6-41c3-ad14-ecdea3181455 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [46ff3f30-b919-4aad-95ec-9126c43fea04] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 19:14:19.256855 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e119b0c-19c6-41c3-ad14-ecdea3181455 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] [46ff3f30-b919-4aad-95ec-9126c43fea04] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 59112. May 12 19:14:19.278889 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO nova.api.openstack.requestlog [None req-3e119b0c-19c6-41c3-ad14-ecdea3181455 tempest-TestVolumeBootPattern-916975640 tempest-TestVolumeBootPattern-916975640-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-417828809" status: 202 len: 0 microversion: 2.1 time: 1.036480 May 12 19:14:19.279478 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: [pid: 117102|app: 0|req: 534/1056] 10.222.0.48 () {58 vars in 1259 bytes} [Thu May 12 19:14:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-417828809 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 19:14:45.430850 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 19:14:45.432312 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Thu May 12 19:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 19:16:07.599853 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 19:16:07.600382 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Thu May 12 19:16:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 19:17:44.226249 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 19:17:44.226982 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Thu May 12 19:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 19:18:05.440038 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 19:18:05.440532 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Thu May 12 19:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 19:19:27.608093 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 19:19:27.608652 dv-cinder-795751-3-iscsi devstack@n-api.service[117101]: Thu May 12 19:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 19:19:34.621769 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 19:19:34.622364 dv-cinder-795751-3-iscsi devstack@n-api.service[117102]: Thu May 12 19:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!